-- Logs begin at Wed 2022-08-24 14:46:42 UTC, end at Wed 2022-08-24 16:05:11 UTC. -- Aug 24 15:17:59.879181 dv-cinder-848900-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 15:17:59.888714 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:17:59 2022] *** Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: nodename: dv-cinder-848900-6-iscsi Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: machine: x86_64 Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: clock source: unix Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: pcre jit disabled Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: detected number of CPU cores: 4 Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: current working directory: / Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: your processes number limit is 47680 Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: your memory page size is 4096 bytes Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: detected max file descriptor number: 2048 Aug 24 15:17:59.890430 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: lock engine: pthread robust mutexes Aug 24 15:17:59.891704 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: thunder lock: enabled Aug 24 15:17:59.891704 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 15:17:59.891704 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:17:59.930419 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: Python main interpreter initialized at 0x558699fc39c0 Aug 24 15:17:59.930419 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: python threads support enabled Aug 24 15:17:59.930419 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: your server socket listen backlog is limited to 100 connections Aug 24 15:17:59.930419 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:17:59.930806 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:17:59.930885 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: *** Operational MODE: preforking *** Aug 24 15:17:59.931112 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:17:59.931112 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: spawned uWSGI master process (pid: 105659) Aug 24 15:17:59.931399 dv-cinder-848900-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 15:17:59.932081 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: spawned uWSGI worker 1 (pid: 105660, cores: 1) Aug 24 15:17:59.932231 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: spawned uWSGI worker 2 (pid: 105661, cores: 1) Aug 24 15:17:59.932420 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:18:00.609500 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:18:00.617810 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:18:01.704294 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:18:01.704294 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: from cryptography.utils import int_from_bytes Aug 24 15:18:01.705256 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:18:01.705256 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: from cryptography.utils import int_from_bytes Aug 24 15:18:01.727422 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:18:01.727422 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: from cryptography.utils import int_from_bytes Aug 24 15:18:01.728030 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:18:01.728030 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: from cryptography.utils import int_from_bytes Aug 24 15:18:04.202243 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:18:04.202836 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:18:04.203013 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:18:04.203376 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:18:04.203626 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:18:04.204009 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.204331 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.204648 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.204787 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:18:04.205278 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.205387 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:18:04.205462 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.205538 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:18:04.205603 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.205878 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.205987 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:18:04.206122 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:18:04.206235 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.206525 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.206618 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.206781 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.206875 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.207095 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.207192 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.207415 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-6-iscsi {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.207518 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.207737 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.207850 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208042 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208140 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208349 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208445 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208663 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208758 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.208964 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.209057 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.209283 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.209377 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.209586 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.209692 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.210013 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-6-iscsi {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.210112 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.210380 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.210543 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.210691 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.210849 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211002 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211157 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211320 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211651 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211788 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.211949 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.212128 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.212255 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.212394 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.212697 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.212788 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213018 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213119 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213408 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213572 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213711 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213799 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-6-iscsi {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.213960 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.214052 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.214295 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.214384 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.214606 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.214694 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.214924 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215020 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215230 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215316 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215554 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215645 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215863 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.215950 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.216220 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.216370 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-6-iscsi {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.216582 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.216805 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.217404 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.217497 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.217707 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.217795 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.218042 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.218146 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.218366 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.218465 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.218667 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.218925 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219025 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219257 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219354 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219571 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219657 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219876 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.219968 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.220179 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.220268 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.220426 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.220521 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.220729 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.220949 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221094 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221193 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221409 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221506 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221716 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221812 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.221964 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222064 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222244 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222348 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222576 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222680 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222895 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.222991 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.223172 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.223263 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.223481 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.223640 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.223812 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.223904 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224085 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224188 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224385 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224483 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224657 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224743 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.224907 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.225003 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.225266 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.225370 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.225579 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.225734 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.225891 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226046 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226210 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226536 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226690 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226852 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.226998 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.227246 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.227343 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.227502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.227589 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.227807 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.227910 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.228140 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.228228 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.228457 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.228555 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.228762 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.228848 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229077 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229264 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229393 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229580 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229695 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229900 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.229987 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.230306 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.230406 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.230567 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.230665 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.230874 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.230970 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.231211 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.231297 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.231470 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.231555 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.231765 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.231862 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.232081 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.232174 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.232402 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.232495 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.232705 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.232801 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233009 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233095 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233312 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233398 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233611 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233703 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.233913 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234002 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234213 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234323 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234506 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234592 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234806 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.234899 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.235106 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.235192 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.235409 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.235505 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.235712 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.235849 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236009 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236095 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236308 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236401 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236604 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236701 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236911 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.236997 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.237216 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.237308 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.237521 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.237613 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.237822 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.237920 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.238123 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.238289 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.238451 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.238553 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.238752 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.238844 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239053 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239146 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239353 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239453 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239657 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239742 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.239957 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240044 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240267 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240363 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240568 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240660 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240868 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.240962 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.241181 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.241303 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.241478 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.241630 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.241780 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.241939 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.242096 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.242262 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.242427 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.242586 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.242726 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.242898 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243037 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243194 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243309 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243514 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243606 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243825 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.243978 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.244127 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.244214 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.244444 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.244531 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.244746 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.244843 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245052 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245147 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245369 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245454 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245675 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245772 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.245979 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.246074 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.246304 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.246403 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.246623 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.246710 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.246945 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.247029 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.247248 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.247333 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.247547 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.247639 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.248045 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.248232 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.248408 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.248555 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.248647 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.248956 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.249077 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.249267 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.249577 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.249663 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.249902 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.250127 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.250282 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.250528 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.250835 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.250935 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.251150 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.251236 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.251463 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.251628 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:18:04.251791 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.251887 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.252106 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.252237 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.252421 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.252600 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.252738 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.252929 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.253045 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.253273 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.253369 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.253664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.253758 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.253979 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.254088 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.254313 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.254403 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.254648 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.254735 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.254983 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.255075 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.255291 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.255430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.255614 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.255751 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.255935 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.256082 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.256245 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.256379 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.256554 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.256702 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.256861 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257038 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257179 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257359 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257511 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257677 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257818 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.257998 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.258133 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.258336 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.258462 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.258659 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.258748 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.258996 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.259082 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.259318 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.259404 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.259633 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.259721 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.259968 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260053 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260280 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260444 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260595 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260693 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260906 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.260992 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.261221 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.261316 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.261531 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.261618 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.261840 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.261925 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.262147 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.262282 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.262501 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.262588 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.262812 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.262919 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.263116 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.263216 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.263945 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264047 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264252 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264373 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264572 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264670 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264895 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.264989 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.265203 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.265288 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.265514 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.265600 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.265832 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.265936 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.266140 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.266351 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.266458 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.266677 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.266771 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.266995 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.267083 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.267318 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.267418 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.267636 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.267722 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.267951 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268045 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268266 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268354 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268572 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268659 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268878 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.268963 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.269185 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.269324 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.269478 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.269586 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.269779 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.269869 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.270091 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.270186 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.270423 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.270513 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.270733 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.270808 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271044 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271152 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271350 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271437 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271659 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271760 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.271971 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.272057 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.272280 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.272366 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.272609 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.272692 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.272918 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.273004 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.273229 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.273326 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.273535 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.273628 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.273857 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.274034 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.274173 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.274377 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.274510 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.274690 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.274819 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275015 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275111 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275328 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275422 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275731 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.275952 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.276045 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.276264 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.276360 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.276572 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.276664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.277127 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.277262 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.277431 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.277591 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.277733 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.277919 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.278060 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.278305 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.278417 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.278595 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.278679 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.278998 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.279090 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.279829 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.279924 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.280160 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.280245 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.280466 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.280551 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.280801 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.280893 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.281119 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.281215 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.281426 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.281512 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.281760 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.281861 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.282045 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.282158 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.282386 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.282499 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.282697 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.282798 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283008 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283094 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283318 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283517 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283630 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283718 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.283950 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284036 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284260 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284349 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284580 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284668 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284888 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.284974 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.285193 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.285278 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.285500 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.285586 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.285806 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.285891 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.286109 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.286295 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.286446 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.286648 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.286784 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.286956 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.287118 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.287328 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.287443 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.287635 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.287731 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.287985 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.288083 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.288324 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.288468 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.288770 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.288897 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289065 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289203 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289321 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289412 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289509 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289577 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289817 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.289933 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.290127 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.290323 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.290592 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.290697 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.290905 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.291055 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.291306 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.291403 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.291601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.291705 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.291915 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292016 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292212 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292377 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292523 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292669 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292809 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.292964 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.293191 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.293342 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.293490 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.293653 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.293754 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.293893 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.294021 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.294095 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.294367 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.294494 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.294708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.294831 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295012 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295102 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295316 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295505 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295610 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295812 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.295913 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.296125 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.296267 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.296437 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.296539 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.296758 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.296855 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297104 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297193 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297382 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297559 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297707 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297841 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.297982 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.298109 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.298287 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.298387 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.298606 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.298758 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.298920 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.299012 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.299227 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.299326 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.299547 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.299724 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.299847 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.300055 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.300223 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.300371 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.300476 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.300675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.300786 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301020 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301160 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301296 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301442 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301612 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301738 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.301911 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.302051 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.302208 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.302386 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.302525 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.302666 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.302835 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303024 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303223 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303368 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303509 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303653 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303820 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.303967 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304114 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304237 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304354 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304484 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304598 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304678 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304870 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.304996 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.305176 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.305331 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.305484 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.305576 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.305810 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.305972 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.306119 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.306345 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.306449 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.306617 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.306777 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.306924 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.307051 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.307229 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.307436 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.307565 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.307672 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.307884 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308035 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308209 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308352 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308517 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308663 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308785 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.308881 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.309067 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.309405 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.309512 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.309748 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.309838 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.310063 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.310207 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.310433 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.310557 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.310750 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.310875 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.311129 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.311266 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.311402 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.311494 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.311781 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.311907 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312062 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312222 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312394 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312538 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312679 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312832 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.312980 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313145 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313355 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313505 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313613 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313752 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313889 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.313986 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.314126 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.314357 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.314452 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.314534 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.314749 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.314900 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315054 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315258 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315383 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315565 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315703 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315865 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.315986 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.316197 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.316453 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.316556 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.316652 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.316827 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.317073 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.317217 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.317410 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.317647 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.317914 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318070 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318070 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318321 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318479 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318573 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318654 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318735 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.318966 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.319121 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.319274 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.319381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.319593 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.319696 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.319919 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.320095 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.320263 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.320404 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.320564 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.320712 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.320872 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321038 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321184 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321305 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321528 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321655 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321774 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.321919 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.322077 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.322265 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.322479 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.322586 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.322783 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.322926 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323080 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323159 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323380 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323582 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323733 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323861 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.323979 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.324095 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.324284 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.324382 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.324585 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.324748 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.324895 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.325058 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.325178 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.325427 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.325558 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.325693 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.326372 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.326545 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.326639 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.326853 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.326964 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.327131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.327344 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.327504 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.327718 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.327872 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.327961 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.328043 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.328123 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.328347 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.328439 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.328661 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.328751 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329067 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329285 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329375 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329457 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329560 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329770 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329866 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.329982 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.330157 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.330376 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.330606 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.330692 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.330774 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.330875 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331073 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331170 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331377 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331548 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331664 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331762 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.331975 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332261 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332352 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332563 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332654 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332872 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.332972 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.333176 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.333271 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.333473 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.333628 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.333774 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.333986 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334084 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334169 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334409 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334686 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334784 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334867 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.334972 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.335194 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.335297 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.335380 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.335550 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.335644 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.335851 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336076 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336227 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336322 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336515 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336695 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336883 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.336986 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337071 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337152 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337316 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337541 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337627 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337808 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.337912 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338057 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338215 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338380 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338554 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338702 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338846 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.338943 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.339147 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.339240 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.339451 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.339539 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.339756 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.339850 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340059 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340144 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340362 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340451 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340669 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340754 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.340976 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.341060 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.341278 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.341374 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.342116 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.342213 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.342451 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.342537 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.342754 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.342840 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343055 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343138 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343354 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343447 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343661 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343747 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.343962 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344047 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344261 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344424 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344589 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344725 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344862 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.344950 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.345161 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.345256 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.345479 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.345563 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.345781 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.345865 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.346083 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.346177 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.346411 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.346506 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.346721 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.346818 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347028 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347115 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347334 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347427 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347643 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347729 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.347953 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348041 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348261 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348355 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348578 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348676 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348879 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.348974 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.349187 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.349333 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.349490 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.349576 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.349800 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.349897 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.350107 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.350194 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.350440 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.350541 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.350741 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.350862 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351048 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351355 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351516 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351701 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351808 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.351952 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.352086 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.352285 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.352381 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.352607 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.352709 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.352925 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353012 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353249 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353353 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353551 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353646 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353856 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.353941 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.354168 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.354288 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.354515 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.354602 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.354819 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.354905 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.355124 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.355240 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.355462 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.355548 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.355773 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.355871 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.356083 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.356170 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.356391 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.356477 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.356700 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.356786 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357003 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357143 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357365 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357459 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357673 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357759 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.357989 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.358076 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.358322 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.358424 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.358651 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.358746 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.358952 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.359037 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.359271 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.359405 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.359575 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.359691 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.359882 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.360002 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.360184 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.360308 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.360631 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.360727 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.360925 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361010 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361233 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361327 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361536 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361630 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361844 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.361987 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.362150 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.362266 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.362488 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.362588 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.362798 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.362884 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.363099 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.363185 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.363443 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.363530 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.363768 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.363853 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364079 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364164 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364393 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364487 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364692 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364784 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.364995 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.365114 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.365301 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.365493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.365648 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.365786 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.365930 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.366087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.366262 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.366382 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.366515 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.366756 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.366886 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367003 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367119 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367278 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367464 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367582 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367824 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.367956 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.368138 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.368289 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.368419 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.368547 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.368775 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.368905 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.369081 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.369229 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.369402 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.369527 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.369707 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.369846 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370019 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370168 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370378 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370500 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370648 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370768 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.370950 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371073 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371240 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371360 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371557 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371687 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371861 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.371998 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.372163 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.372286 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.372476 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.372597 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.372813 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.372958 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.373135 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.373264 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.373437 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.373566 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.373748 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.373902 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374070 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374169 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374353 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374488 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374659 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374785 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.374962 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.375095 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.375303 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.375437 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.375612 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.375753 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.375932 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.376047 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.376261 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.376388 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.376576 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.376684 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.376885 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377028 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377191 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377322 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377512 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377644 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377819 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.377959 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.378107 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.378260 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.378453 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.378548 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.378761 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.378880 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379065 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379199 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379364 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379669 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379787 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.379972 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.380084 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.380277 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.380376 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.380590 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.380723 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.380892 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381021 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381196 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381320 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381495 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381631 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381815 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.381985 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.382120 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.382316 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.382445 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.382590 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.382713 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.382837 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383012 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383142 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383329 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383563 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383691 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383817 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.383941 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.384062 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.384368 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.384507 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.384634 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.384848 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.385284 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.385462 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.385742 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.385955 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386090 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386358 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386462 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386549 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386648 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386741 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386823 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386903 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.386983 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387072 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387072 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387236 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387325 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387406 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387605 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387704 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.387906 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.388003 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.388211 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.388820 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.389037 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.389142 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.389344 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.389604 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.389708 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.389933 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390023 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390272 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390366 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390581 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390683 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390891 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.390979 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.391196 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.391285 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.391498 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.391589 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.391802 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.391903 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.392107 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.392195 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.392417 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.392507 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.392726 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.392825 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.393050 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.393138 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.393356 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.393453 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.393682 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.393821 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394000 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394152 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394378 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394542 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394704 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394851 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.394978 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395078 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395238 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395329 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395550 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395641 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395863 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.395954 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.396170 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.396273 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.396487 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.396578 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.396796 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.396883 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.397110 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.397212 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.397422 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.397679 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.397768 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398006 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398096 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398343 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398451 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398656 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398747 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.398967 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399056 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399279 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399373 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399586 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399730 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399895 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.399999 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.400205 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.400294 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.400513 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.400602 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.400821 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.400925 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.401134 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.401223 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.401450 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.401546 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.401773 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.402286 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.402395 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.402596 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.402688 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.402928 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.403026 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.403252 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.403350 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.403576 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.403665 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.403891 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.404071 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.404790 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.404947 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405068 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405182 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405377 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405508 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405666 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405816 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.405978 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.406308 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.406452 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.406613 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.406734 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.406925 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407051 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407227 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407360 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407535 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407635 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407842 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.407930 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.408146 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.408244 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.408457 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.408696 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.408787 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.409044 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.409149 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.409359 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.409449 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.409684 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.409832 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410004 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410103 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410342 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410436 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410651 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410740 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.410974 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.411202 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.411301 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.411513 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.411602 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.411846 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.411944 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.412162 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.412252 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.412471 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.412578 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.412772 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.412878 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413079 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413176 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413384 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413477 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413689 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413857 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.413991 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.414080 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.414316 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.414407 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.414624 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.414726 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.414929 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415061 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415229 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415325 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415838 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.415926 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.416136 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.416232 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.416438 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.416531 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.416740 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.416970 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.417061 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.417318 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.417416 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.417622 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.417718 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.417926 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418016 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418269 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418376 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418586 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418703 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418896 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.418997 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.419209 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.419312 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.419511 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.419651 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.419839 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.419927 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.420145 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.420243 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.420449 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.420538 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.420752 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.420841 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421055 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421145 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421361 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421450 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421667 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421765 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.421971 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.422063 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.422298 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.422443 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.422603 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.422700 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.422928 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.423177 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.423275 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.423513 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.423603 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.423814 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.423903 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.424123 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.424213 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.424424 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.424520 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.424726 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.424817 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425029 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425122 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425339 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425429 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425651 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425743 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.425955 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426034 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426281 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426372 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426585 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426675 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426890 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.426978 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.427190 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.427287 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.427495 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.427584 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.427795 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.427883 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.428101 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.428201 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.428408 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.428496 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.428711 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.428799 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429018 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429118 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429324 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429414 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429630 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429721 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.429936 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.430033 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.430272 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.430365 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.430622 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.430723 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.430939 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.431036 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.431254 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.431519 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.431608 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.431858 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.431961 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.432169 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.432264 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.432479 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.432618 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.432787 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.432890 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.433096 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.433186 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.433405 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.433500 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.433712 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.433804 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434030 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434118 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434357 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434461 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434666 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434789 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.434978 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.435099 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.435814 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.435946 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.436125 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.436265 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.436434 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.436573 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.436743 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.436894 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.437051 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.437216 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.437358 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.437526 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.437673 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.437960 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438132 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438203 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438354 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438486 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438606 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438829 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.438920 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.439158 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.439246 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.439483 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.439587 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.439787 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.439885 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.440092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.440182 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.440396 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.440494 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.440709 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.440812 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.441022 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.441122 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.441334 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.441640 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.441730 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.441944 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442040 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442286 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442382 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442582 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442676 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442887 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.442976 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.443191 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.443363 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.443497 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.443595 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.443803 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.443944 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.444107 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.444254 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.444409 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.444569 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.444711 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.444887 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445012 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445199 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445312 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445518 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445616 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445840 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.445988 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.446150 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.446255 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.446494 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.446584 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.446798 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.446899 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.447100 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.447190 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.447403 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.447493 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.447733 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.447832 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448064 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448154 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448365 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448499 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448668 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448767 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.448972 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449062 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449281 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449370 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449587 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449677 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449894 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.449981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.450301 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.450406 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.450576 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.450716 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.450841 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.451523 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.451665 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.451765 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.451972 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452064 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452326 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452424 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452580 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452671 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452885 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.452976 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.453185 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.453275 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.453488 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.453586 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.453791 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.453881 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.454092 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.454182 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.454420 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.454521 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.454730 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.454820 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455035 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455132 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455336 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455434 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455734 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.455936 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.456077 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.456237 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.456329 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.456563 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.456665 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.456875 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.457206 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.457332 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.457477 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.457568 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.457785 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.457883 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.458099 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.458199 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.458430 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.458587 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.458741 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.458919 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.459063 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.459230 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.459375 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.459554 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.459700 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.459879 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460025 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460195 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460334 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460504 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460657 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460836 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.460984 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.461145 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.461330 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.461454 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.461640 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.461766 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.461983 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.462074 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.462337 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.462430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.462652 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.462755 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.462962 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.463054 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.463266 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.463355 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.463507 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:18:04.463606 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.463919 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.464239 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.464562 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.464876 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.465190 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.465518 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.465829 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.466138 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.466501 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.466813 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.467122 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.467438 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.467747 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.468057 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.468373 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.468690 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.469015 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.469340 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.469650 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.469976 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.470330 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.470680 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.470992 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.471335 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.471663 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.471981 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.472463 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.472996 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:18:04.473431 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:18:04.616469 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Registered counter for database nova_api Aug 24 15:18:04.639888 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO dbcounter [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Registered counter for database nova_api Aug 24 15:18:04.640092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.646070 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.659273 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.665826 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writer thread running {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.703267 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.context [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fabf33d6-d538-4599-b25e-492b9bb37677(cell1) {{(pid=105660) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:18:04.707145 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:18:04.707613 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:18:04.709207 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:18:04.709937 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:18:04.710410 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:18:04.712390 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:18:04.714384 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Registered counter for database nova_cell0 Aug 24 15:18:04.719883 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Registered counter for database nova_cell1 Aug 24 15:18:04.722607 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.context [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fabf33d6-d538-4599-b25e-492b9bb37677(cell1) {{(pid=105661) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:18:04.727898 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_concurrency.lockutils [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:18:04.727898 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_concurrency.lockutils [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:18:04.728216 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.728681 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_concurrency.lockutils [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:18:04.729449 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_concurrency.lockutils [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:18:04.729773 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.729883 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_concurrency.lockutils [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:18:04.731924 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_concurrency.lockutils [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:18:04.733988 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO dbcounter [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Registered counter for database nova_cell0 Aug 24 15:18:04.734441 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.739684 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO dbcounter [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Registered counter for database nova_cell1 Aug 24 15:18:04.747361 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.751688 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.754617 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writer thread running {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.874834 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.884944 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Registered counter for database nova_cell0 Aug 24 15:18:04.894153 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.894638 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writer thread running {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.898886 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:04.903869 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO dbcounter [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Registered counter for database nova_cell0 Aug 24 15:18:04.913021 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:18:04.917711 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writer thread running {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:18:05.241719 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: WARNING keystonemiddleware.auth_token [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:18:05.242674 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:18:05.249018 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: WARNING keystonemiddleware.auth_token [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:18:05.249953 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:18:05.590663 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: WARNING keystonemiddleware.auth_token [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:18:05.593282 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:18:05.597199 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: WARNING keystonemiddleware.auth_token [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:18:05.599246 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:18:05.602489 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558699fc39c0 pid: 105661 (default app) Aug 24 15:18:05.604537 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:18:05.604649 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558699fc39c0 pid: 105660 (default app) Aug 24 15:18:05.605706 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-c2a263af-e505-496d-b0c7-91d843024a12 None None] 10.222.0.76 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001708 Aug 24 15:18:05.606102 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 788 bytes} [Wed Aug 24 15:18:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:24.862280 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:24.864110 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002628 Aug 24 15:19:24.870546 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:24.882178 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_api:SELECT=3 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:24.884842 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_cell0:SELECT=3 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:24.884842 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_cell1:SELECT=3 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:24.886419 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_cell0:SELECT=3 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:25.919125 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-67a146e0-0db9-44ca-b8e1-9ab2ef2cd500 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:25.953824 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-67a146e0-0db9-44ca-b8e1-9ab2ef2cd500 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.081954 Aug 24 15:19:25.954567 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 2/3] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 15:19:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:28.445792 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:28.447404 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-72fcd0d7-bc28-4766-9157-5e0e850c0cd9 None None] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004963 Aug 24 15:19:28.448363 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 2/4] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:28.992118 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-b42b4939-9a8f-44ee-99fb-97a347884c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "disk": 1}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:29.015650 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:19:29.015650 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: warnings.warn(msg) Aug 24 15:19:29.050476 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-b42b4939-9a8f-44ee-99fb-97a347884c17 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.593519 Aug 24 15:19:29.050987 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 3/5] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:29.065252 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=3 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:29.065714 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=3 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:29.067014 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell1:SELECT=3 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:29.067801 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:29.282325 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-5f5d19c2-6327-45d2-9a3f-e53d02e6c482 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:29.286655 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:19:29.286655 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: warnings.warn(msg) Aug 24 15:19:29.349235 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-5f5d19c2-6327-45d2-9a3f-e53d02e6c482 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289576 Aug 24 15:19:29.349894 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 3/6] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 15:19:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:31.829379 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-b42b4939-9a8f-44ee-99fb-97a347884c17 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:31.831129 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-b42b4939-9a8f-44ee-99fb-97a347884c17 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 Aug 24 15:19:31.832036 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 4/7] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:32.673733 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-b6d4390a-3e37-41c4-b323-1972ca4141d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "ds512M", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:32.694976 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:19:32.694976 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: warnings.warn(msg) Aug 24 15:19:32.720349 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-b6d4390a-3e37-41c4-b323-1972ca4141d1 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.878503 Aug 24 15:19:32.721495 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 4/8] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:32.739636 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-9994539b-5632-4c93-9e2c-1925fc37f2a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:32.744084 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:19:32.744084 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: warnings.warn(msg) Aug 24 15:19:32.787247 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-9994539b-5632-4c93-9e2c-1925fc37f2a2 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052574 Aug 24 15:19:32.789199 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 5/9] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 15:19:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:35.448753 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-b6d4390a-3e37-41c4-b323-1972ca4141d1 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:35.449761 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-b6d4390a-3e37-41c4-b323-1972ca4141d1 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 24 15:19:35.450280 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:19:35.960475 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-b5493ae9-e9b2-4463-bc08-75ab7221edf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:35.981500 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-b5493ae9-e9b2-4463-bc08-75ab7221edf3 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520778 Aug 24 15:19:35.981500 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 6/11] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:35.993724 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-70ad6c2c-e1e9-48b6-9772-faca2f6842ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:36.020148 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-70ad6c2c-e1e9-48b6-9772-faca2f6842ef admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030205 Aug 24 15:19:36.020732 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 6/12] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 15:19:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:38.529192 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-b5493ae9-e9b2-4463-bc08-75ab7221edf3 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:38.532125 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-b5493ae9-e9b2-4463-bc08-75ab7221edf3 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002445 Aug 24 15:19:38.534191 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 7/13] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:39.127159 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-f3339586-c0b5-46df-8295-8aee7e4cdd69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:39.149295 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-f3339586-c0b5-46df-8295-8aee7e4cdd69 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.608356 Aug 24 15:19:39.149947 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 7/14] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:39.162488 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-bf75111f-97c0-4ab5-9200-c0ba286c4dce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:39.190344 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-bf75111f-97c0-4ab5-9200-c0ba286c4dce admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031508 Aug 24 15:19:39.190905 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 8/15] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 15:19:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:41.750469 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-f3339586-c0b5-46df-8295-8aee7e4cdd69 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:41.751488 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-f3339586-c0b5-46df-8295-8aee7e4cdd69 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 15:19:41.752044 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 8/16] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:42.224595 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-63fefcef-ff8c-4401-9642-9c1d77e6bb66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:42.246601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-63fefcef-ff8c-4401-9642-9c1d77e6bb66 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488019 Aug 24 15:19:42.247492 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 9/17] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:42.259822 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-d4934320-a002-4228-a197-d0009579d0a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:42.286446 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-d4934320-a002-4228-a197-d0009579d0a2 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030180 Aug 24 15:19:42.295712 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 9/18] 10.222.0.76 () {64 vars in 1336 bytes} [Wed Aug 24 15:19:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:44.773346 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-63fefcef-ff8c-4401-9642-9c1d77e6bb66 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:44.774387 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-63fefcef-ff8c-4401-9642-9c1d77e6bb66 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 15:19:44.774804 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 10/19] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:45.323123 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-e05dd24b-766c-46f0-bc1d-34afaffe3e28 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:45.348178 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-e05dd24b-766c-46f0-bc1d-34afaffe3e28 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.566817 Aug 24 15:19:45.348738 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 10/20] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 15:19:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:19:47.881084 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-63fefcef-ff8c-4401-9642-9c1d77e6bb66 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:47.881999 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-63fefcef-ff8c-4401-9642-9c1d77e6bb66 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 15:19:47.882470 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 11/21] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:48.379027 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-0ec819ad-e382-4118-b0d8-da57be89772a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:48.407812 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-0ec819ad-e382-4118-b0d8-da57be89772a admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.517862 Aug 24 15:19:48.408366 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 11/22] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:48.421168 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-b44bbc1c-856f-41f6-b5d5-d6bb0623a53d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:48.446604 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-b44bbc1c-856f-41f6-b5d5-d6bb0623a53d admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029130 Aug 24 15:19:48.447206 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 12/23] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 15:19:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:51.045806 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-0ec819ad-e382-4118-b0d8-da57be89772a admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:51.048721 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-0ec819ad-e382-4118-b0d8-da57be89772a admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003651 Aug 24 15:19:51.050385 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 12/24] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:51.576919 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-eebc2a5a-9f6b-4412-b039-a93187de0a1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:51.596401 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-eebc2a5a-9f6b-4412-b039-a93187de0a1f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.536068 Aug 24 15:19:51.596962 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 13/25] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:51.609379 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-f00a107b-8f27-443d-a627-a7249d175b55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:51.637229 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-f00a107b-8f27-443d-a627-a7249d175b55 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031312 Aug 24 15:19:51.637772 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 13/26] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 15:19:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:54.142772 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-eebc2a5a-9f6b-4412-b039-a93187de0a1f admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:54.143684 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-eebc2a5a-9f6b-4412-b039-a93187de0a1f admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 24 15:19:54.144292 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 14/27] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:54.542755 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-cffb5453-c977-4817-98eb-537936c6ebf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:54.565529 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-cffb5453-c977-4817-98eb-537936c6ebf8 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.414897 Aug 24 15:19:54.567029 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 14/28] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:19:54.579451 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-9ee1db93-a7b5-45b6-9dcd-04b01ddfcc49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:54.605325 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-9ee1db93-a7b5-45b6-9dcd-04b01ddfcc49 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029676 Aug 24 15:19:54.606192 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 15/29] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 15:19:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:19:57.050351 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-cffb5453-c977-4817-98eb-537936c6ebf8 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:19:57.051362 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-cffb5453-c977-4817-98eb-537936c6ebf8 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 15:19:57.051958 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 15/30] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:19:57.549860 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-0cadd701-af21-42ae-b184-869edc03b022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "swap": 0, "id": "4"}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:57.556789 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:19:57.575112 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-0cadd701-af21-42ae-b184-869edc03b022 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516423 Aug 24 15:19:57.578255 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 16/31] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:19:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:19:57.588730 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-019aa571-4f04-40af-a2f0-3ad47e67d871 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:19:57.620082 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-019aa571-4f04-40af-a2f0-3ad47e67d871 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035812 Aug 24 15:19:57.634251 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 16/32] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 15:19:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:20:00.136718 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-0cadd701-af21-42ae-b184-869edc03b022 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:00.139976 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-0cadd701-af21-42ae-b184-869edc03b022 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004033 Aug 24 15:20:00.140680 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 17/33] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:00.714492 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-596f2c3e-c6a2-4a9a-b479-fa4d8699fafe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:20:00.720464 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:20:00.743471 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-596f2c3e-c6a2-4a9a-b479-fa4d8699fafe admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.595442 Aug 24 15:20:00.744054 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 17/34] 10.222.0.76 () {64 vars in 1283 bytes} [Wed Aug 24 15:20:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:20:00.756573 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-09c95872-d40c-418d-816f-1ace2456072f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:20:00.787203 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-09c95872-d40c-418d-816f-1ace2456072f admin admin] 10.222.0.76 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034551 Aug 24 15:20:00.787894 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 18/35] 10.222.0.76 () {64 vars in 1333 bytes} [Wed Aug 24 15:20:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:20:19.851822 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-596f2c3e-c6a2-4a9a-b479-fa4d8699fafe admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:19.853319 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-596f2c3e-c6a2-4a9a-b479-fa4d8699fafe admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 15:20:19.853715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 18/36] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:20:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:19.864573 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:20:20.255401 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-6bc55bf7-2957-4a6a-91e1-5fc5e9bf330d admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:20.273811 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-6bc55bf7-2957-4a6a-91e1-5fc5e9bf330d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413663 Aug 24 15:20:20.274368 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 19/37] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 15:20:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:20:21.347913 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-596f2c3e-c6a2-4a9a-b479-fa4d8699fafe admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:21.348906 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-596f2c3e-c6a2-4a9a-b479-fa4d8699fafe admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 24 15:20:21.349298 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 19/38] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:21.880329 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-a7bb9ceb-06c8-497e-a340-359eaab79959 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:21.886460 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.wsgi [None req-a7bb9ceb-06c8-497e-a340-359eaab79959 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-a7bb9ceb-06c8-497e-a340-359eaab79959 admin admin] Request method failure captured: Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Accept: application/json Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Accept-Encoding: gzip, deflate Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Connection: keep-alive Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Content-Length: 0 Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Host: 10.222.0.76 Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Openstack-Api-Version: compute 2.90 Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Openstack-System-Scope: None Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: User-Agent: python-novaclient Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Auth-Token: gAAAAABjBkG1if11ebSGeInRhk3kSiJ2nX0kXkqPg1zfh3SvsiyJhthfM8v-mjDMCuEgZwyZmgKAPqvycyQcdaTyOVXq29BCC5pwmRSnkC_vTVcCaT2n8W_eZMjdlXTp7SyJH6c808S6usq8er66WmFS7hdmbL-C-x8ZomxITw908rl_L3ncxbk Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Domain-Id: None Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Domain-Name: None Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Identity-Status: Confirmed Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Is-Admin-Project: True Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Domain-Id: default Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Domain-Name: Default Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Name: admin Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Role: reader,member,admin Aug 24 15:20:21.889637 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Roles: reader,member,admin Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e70c51040e434074a3d61be0b7c8533b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}] Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant: admin Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant-Name: admin Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User: admin Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Domain-Id: default Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Domain-Name: Default Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Id: 793b87d316d544f9aecda76f798927dc Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Name: admin Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: method: > Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: exception: Flavor 42 could not be found. Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: action_args: {'id': '42'} Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:20:21.891430 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:21.892626 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.894098 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-a7bb9ceb-06c8-497e-a340-359eaab79959 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:20:21.895488 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-a7bb9ceb-06c8-497e-a340-359eaab79959 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402405 Aug 24 15:20:21.895488 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 20/39] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 15:20:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:20:21.901555 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-b92f709c-f60a-4b4c-b7da-22c4335c9605 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:21.924157 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-b92f709c-f60a-4b4c-b7da-22c4335c9605 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026989 Aug 24 15:20:21.924700 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 20/40] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 15:20:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:20:21.934527 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-77ad2616-82ae-4f0c-97cf-ae911dead170 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:21.958373 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-77ad2616-82ae-4f0c-97cf-ae911dead170 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027480 Aug 24 15:20:21.958902 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 21/41] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 15:20:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:20:21.968969 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-73b24b5b-dd06-4596-bbdd-be3d9e6aa2af admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:21.974653 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.wsgi [None req-73b24b5b-dd06-4596-bbdd-be3d9e6aa2af admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-73b24b5b-dd06-4596-bbdd-be3d9e6aa2af admin admin] Request method failure captured: Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Accept: application/json Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Accept-Encoding: gzip, deflate Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Connection: keep-alive Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Content-Length: 0 Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Host: 10.222.0.76 Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Openstack-Api-Version: compute 2.90 Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Openstack-System-Scope: None Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: User-Agent: python-novaclient Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Auth-Token: gAAAAABjBkG1if11ebSGeInRhk3kSiJ2nX0kXkqPg1zfh3SvsiyJhthfM8v-mjDMCuEgZwyZmgKAPqvycyQcdaTyOVXq29BCC5pwmRSnkC_vTVcCaT2n8W_eZMjdlXTp7SyJH6c808S6usq8er66WmFS7hdmbL-C-x8ZomxITw908rl_L3ncxbk Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Domain-Id: None Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Domain-Name: None Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Identity-Status: Confirmed Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Is-Admin-Project: True Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Id: default Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Name: Default Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Name: admin Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Role: reader,member,admin Aug 24 15:20:21.978087 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Roles: reader,member,admin Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e70c51040e434074a3d61be0b7c8533b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}] Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant: admin Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant-Name: admin Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User: admin Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Id: default Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Name: Default Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Id: 793b87d316d544f9aecda76f798927dc Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Name: admin Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: method: > Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: exception: Flavor 42 could not be found. Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: action_args: {'id': '42'} Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:20:21.979882 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:21.980708 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:21.981715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-73b24b5b-dd06-4596-bbdd-be3d9e6aa2af admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:20:21.982730 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-73b24b5b-dd06-4596-bbdd-be3d9e6aa2af admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014222 Aug 24 15:20:21.982730 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 21/42] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 15:20:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:20:22.942012 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-77ad2616-82ae-4f0c-97cf-ae911dead170 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:22.943033 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-77ad2616-82ae-4f0c-97cf-ae911dead170 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 15:20:22.943449 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 22/43] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:23.471110 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-da47f03f-6279-465a-9ec2-f5c4a2192ec3 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:23.476447 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.wsgi [None req-da47f03f-6279-465a-9ec2-f5c4a2192ec3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-da47f03f-6279-465a-9ec2-f5c4a2192ec3 admin admin] Request method failure captured: Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Accept: application/json Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Accept-Encoding: gzip, deflate Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Connection: keep-alive Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Content-Length: 0 Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Host: 10.222.0.76 Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Openstack-Api-Version: compute 2.90 Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Openstack-System-Scope: None Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: User-Agent: python-novaclient Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Auth-Token: gAAAAABjBkG2vc7jrQM6WBsfAmtJnTfvYkGcWg0VPqIOCpjoxw8n6tfnZOSLF_bV3iMl6qNairXUeOqXFwNI87dRQIABHQ9bnBZqF7ymB15gBe-hyUcZsLQaozd8YsMlb0L7NxrsGBuskM3cjI65WQgwdcqDjtujRZX43AhSaBO-BpzTvfHrJ-E Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Domain-Id: None Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Domain-Name: None Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Identity-Status: Confirmed Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Is-Admin-Project: True Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Id: default Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Name: Default Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Name: admin Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Role: reader,member,admin Aug 24 15:20:23.478502 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Roles: reader,member,admin Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e70c51040e434074a3d61be0b7c8533b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}] Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant: admin Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant-Name: admin Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User: admin Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Id: default Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Name: Default Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Id: 793b87d316d544f9aecda76f798927dc Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Name: admin Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: method: > Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: exception: Flavor 84 could not be found. Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: action_args: {'id': '84'} Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:20:23.481493 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:23.482532 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.483831 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-da47f03f-6279-465a-9ec2-f5c4a2192ec3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:20:23.485180 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-da47f03f-6279-465a-9ec2-f5c4a2192ec3 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395977 Aug 24 15:20:23.485180 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 15:20:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:20:23.490196 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-5ed427e8-a736-4a5e-8393-a520386bc3ee admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:23.505705 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-5ed427e8-a736-4a5e-8393-a520386bc3ee admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019114 Aug 24 15:20:23.506256 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 23/45] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 15:20:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:20:23.515886 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-eaaee134-1bd7-47f5-ad1b-d6ab4bf94ac2 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:23.531715 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-eaaee134-1bd7-47f5-ad1b-d6ab4bf94ac2 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019401 Aug 24 15:20:23.532480 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 15:20:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:20:23.542278 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-a56a1a39-331c-457c-886d-1ba2d16dae5b admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:23.547646 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.wsgi [None req-a56a1a39-331c-457c-886d-1ba2d16dae5b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-a56a1a39-331c-457c-886d-1ba2d16dae5b admin admin] Request method failure captured: Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Accept: application/json Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Accept-Encoding: gzip, deflate Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Connection: keep-alive Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Content-Length: 0 Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Host: 10.222.0.76 Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Openstack-Api-Version: compute 2.90 Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Openstack-System-Scope: None Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: User-Agent: python-novaclient Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Auth-Token: gAAAAABjBkG2vc7jrQM6WBsfAmtJnTfvYkGcWg0VPqIOCpjoxw8n6tfnZOSLF_bV3iMl6qNairXUeOqXFwNI87dRQIABHQ9bnBZqF7ymB15gBe-hyUcZsLQaozd8YsMlb0L7NxrsGBuskM3cjI65WQgwdcqDjtujRZX43AhSaBO-BpzTvfHrJ-E Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Domain-Id: None Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Domain-Name: None Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Identity-Status: Confirmed Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Is-Admin-Project: True Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Domain-Id: default Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Domain-Name: Default Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Name: admin Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Role: reader,member,admin Aug 24 15:20:23.549136 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Roles: reader,member,admin Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e70c51040e434074a3d61be0b7c8533b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}] Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant: admin Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant-Name: admin Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User: admin Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Domain-Id: default Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Domain-Name: Default Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Id: 793b87d316d544f9aecda76f798927dc Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Name: admin Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: method: > Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: exception: Flavor 84 could not be found. Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: action_args: {'id': '84'} Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:20:23.550601 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:23.551664 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:23.553056 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-a56a1a39-331c-457c-886d-1ba2d16dae5b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:20:23.554422 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-a56a1a39-331c-457c-886d-1ba2d16dae5b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012234 Aug 24 15:20:23.554422 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 24/47] 10.222.0.76 () {60 vars in 1190 bytes} [Wed Aug 24 15:20:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:20:24.519235 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-eaaee134-1bd7-47f5-ad1b-d6ab4bf94ac2 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:24.520234 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-eaaee134-1bd7-47f5-ad1b-d6ab4bf94ac2 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 15:20:24.520632 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 24/48] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:25.054663 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-5fac7304-d81a-490e-bd6f-67cf3c38ab68 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:25.060360 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.wsgi [None req-5fac7304-d81a-490e-bd6f-67cf3c38ab68 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-5fac7304-d81a-490e-bd6f-67cf3c38ab68 admin admin] Request method failure captured: Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Accept: application/json Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Accept-Encoding: gzip, deflate Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Connection: keep-alive Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Content-Length: 0 Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Host: 10.222.0.76 Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Openstack-Api-Version: compute 2.90 Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Openstack-System-Scope: None Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: User-Agent: python-novaclient Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Auth-Token: gAAAAABjBkG4xHbc3Z1otlQBw8Ajbhmq5OCDfbKr6s8JBAYLEEHXbjMncudaaP_sfEhLmIKmM8k_9bMl4hU8KaEBfZ6CNyyXawAEmu0xDRTG636trGyB3dEdoLQ79_vh2vhZTWqRkxOUD4HMUb6URFYGk0SuS5FRwPvDMWjup6edEm-Snh5CRoo Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Domain-Id: None Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Domain-Name: None Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Identity-Status: Confirmed Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Is-Admin-Project: True Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Domain-Id: default Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Domain-Name: Default Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Project-Name: admin Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Role: reader,member,admin Aug 24 15:20:25.062085 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Roles: reader,member,admin Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e70c51040e434074a3d61be0b7c8533b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}] Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant: admin Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-Tenant-Name: admin Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User: admin Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Domain-Id: default Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Domain-Name: Default Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Id: 793b87d316d544f9aecda76f798927dc Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: X-User-Name: admin Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: method: > Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: exception: Flavor 451 could not be found. Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: action_args: {'id': '451'} Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:20:25.064381 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:25.065675 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.067131 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-5fac7304-d81a-490e-bd6f-67cf3c38ab68 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:20:25.068709 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-5fac7304-d81a-490e-bd6f-67cf3c38ab68 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405361 Aug 24 15:20:25.068709 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 25/49] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 15:20:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:20:25.074664 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-6d20d078-38fe-4a03-a3d2-072e4ce8c38d admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:25.090577 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-6d20d078-38fe-4a03-a3d2-072e4ce8c38d admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020000 Aug 24 15:20:25.091129 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 25/50] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 15:20:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:20:25.100858 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:25.115676 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018409 Aug 24 15:20:25.116215 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 26/51] 10.222.0.76 () {60 vars in 1210 bytes} [Wed Aug 24 15:20:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:20:25.126233 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-9deef86e-8760-4275-8eca-a287408f9794 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:25.131514 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.wsgi [None req-9deef86e-8760-4275-8eca-a287408f9794 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-9deef86e-8760-4275-8eca-a287408f9794 admin admin] Request method failure captured: Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Accept: application/json Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Accept-Encoding: gzip, deflate Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Connection: keep-alive Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Content-Length: 0 Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Host: 10.222.0.76 Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Openstack-Api-Version: compute 2.90 Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Openstack-System-Scope: None Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: User-Agent: python-novaclient Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Auth-Token: gAAAAABjBkG4xHbc3Z1otlQBw8Ajbhmq5OCDfbKr6s8JBAYLEEHXbjMncudaaP_sfEhLmIKmM8k_9bMl4hU8KaEBfZ6CNyyXawAEmu0xDRTG636trGyB3dEdoLQ79_vh2vhZTWqRkxOUD4HMUb6URFYGk0SuS5FRwPvDMWjup6edEm-Snh5CRoo Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Domain-Id: None Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Domain-Name: None Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Identity-Status: Confirmed Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Is-Admin-Project: True Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Id: default Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Name: Default Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Project-Name: admin Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Role: reader,member,admin Aug 24 15:20:25.132995 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Roles: reader,member,admin Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_e70c51040e434074a3d61be0b7c8533b", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/e70c51040e434074a3d61be0b7c8533b"}]}] Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant: admin Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant-Id: e70c51040e434074a3d61be0b7c8533b Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-Tenant-Name: admin Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User: admin Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Id: default Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Name: Default Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Id: 793b87d316d544f9aecda76f798927dc Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: X-User-Name: admin Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: method: > Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: exception: Flavor 451 could not be found. Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: action_args: {'id': '451'} Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:20:25.135092 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:25.135981 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 24 15:20:25.137276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-9deef86e-8760-4275-8eca-a287408f9794 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:20:25.138549 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-9deef86e-8760-4275-8eca-a287408f9794 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012317 Aug 24 15:20:25.138549 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 26/52] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 15:20:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 15:20:26.112609 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:26.113634 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 24 15:20:26.114031 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 27/53] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:26.646975 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-35d93451-816d-4ae0-a0f7-2ab566ad9236 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:20:26.666411 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-35d93451-816d-4ae0-a0f7-2ab566ad9236 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.412336 Aug 24 15:20:26.666951 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 27/54] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 15:20:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:20:27.639129 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:27.640129 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 15:20:27.640528 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 28/55] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:28.190323 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-27c3ea18-35bf-427d-a61b-ca131e9096e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:20:28.208753 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-27c3ea18-35bf-427d-a61b-ca131e9096e3 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.427813 Aug 24 15:20:28.209412 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 28/56] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 15:20:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:20:29.181039 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:29.182102 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Aug 24 15:20:29.182531 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 29/57] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:29.713517 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-ab437db3-cf4b-418f-93b0-02c4734bbdef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:20:29.732384 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-ab437db3-cf4b-418f-93b0-02c4734bbdef admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412207 Aug 24 15:20:29.732922 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 29/58] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 15:20:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:20:30.702469 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:30.703470 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 24 15:20:30.703865 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 30/59] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:31.229492 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-eb39f91c-4f12-4fa9-a4a7-58c3f0000af2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:20:31.248344 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-eb39f91c-4f12-4fa9-a4a7-58c3f0000af2 admin admin] 10.222.0.76 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406750 Aug 24 15:20:31.248927 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 30/60] 10.222.0.76 () {64 vars in 1235 bytes} [Wed Aug 24 15:20:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:20:32.220376 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:32.221371 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 24 15:20:32.221764 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 31/61] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:20:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:20:32.749322 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-d94a2b60-6b51-4e37-89b1-db5340e4d127 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:20:32.771223 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-d94a2b60-6b51-4e37-89b1-db5340e4d127 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.411158 Aug 24 15:20:32.771812 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 31/62] 10.222.0.76 () {60 vars in 1202 bytes} [Wed Aug 24 15:20:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:21:27.361668 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:21:27.362697 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-29f6179a-974b-4f43-a6f0-17ec5d8eb6d5 admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 24 15:21:27.363104 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 32/63] 10.222.0.76 () {54 vars in 931 bytes} [Wed Aug 24 15:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:21:27.373983 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:21:27.787619 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-f93c21bc-7073-4bf5-9bb4-8ccb2e0e2172 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:21:27.809997 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-f93c21bc-7073-4bf5-9bb4-8ccb2e0e2172 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.440359 Aug 24 15:21:27.810585 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 32/64] 10.222.0.76 () {60 vars in 1292 bytes} [Wed Aug 24 15:21:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:21:27.831818 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG dbcounter [-] [105661] Writing DB stats nova_api:SELECT=14 {{(pid=105661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:21:27.836814 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-b164d582-b068-41c4-b550-ac2b235f36c5 admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:21:27.844814 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-b164d582-b068-41c4-b550-ac2b235f36c5 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014418 Aug 24 15:21:27.845366 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 33/65] 10.222.0.76 () {60 vars in 1283 bytes} [Wed Aug 24 15:21:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:21:27.857444 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-cc6b7bd8-74c0-475d-8edd-a3a7cc5baa98 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:21:27.865222 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-cc6b7bd8-74c0-475d-8edd-a3a7cc5baa98 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011362 Aug 24 15:21:27.865684 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 33/66] 10.222.0.76 () {60 vars in 1286 bytes} [Wed Aug 24 15:21:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:21:27.877613 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:21:27.886356 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012262 Aug 24 15:21:27.886906 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 34/67] 10.222.0.76 () {60 vars in 1286 bytes} [Wed Aug 24 15:21:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:21:27.899265 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-e2899616-b7cf-4fe0-937c-6dc340f63df3 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:21:27.907692 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-e2899616-b7cf-4fe0-937c-6dc340f63df3 admin admin] 10.222.0.76 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012529 Aug 24 15:21:27.908232 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 34/68] 10.222.0.76 () {60 vars in 1283 bytes} [Wed Aug 24 15:21:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:24:27.799403 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:27.801059 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Aug 24 15:24:27.801479 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 35/69] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:24:27.945635 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=6 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:24:28.104968 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:28.107465 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:24:28.107465 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: warnings.warn(msg) Aug 24 15:24:28.108573 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:28.109042 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:28.109464 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:28.110171 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:28.110645 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:28.111058 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:28.145938 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-99902326-97dc-45fb-98c6-2b03b79726cf admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201664 Aug 24 15:24:28.146546 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 35/70] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 15:24:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:24:28.979841 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:28.980838 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 24 15:24:28.981246 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 36/71] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:24:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:24:29.176870 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:29.179296 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:24:29.179296 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: warnings.warn(msg) Aug 24 15:24:29.180382 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:29.180856 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:29.181276 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:29.181982 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:29.182453 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:29.182863 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:29.202080 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-c0760fad-dc50-48d9-a941-78c65cdd3324 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080190 Aug 24 15:24:29.202611 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 36/72] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 15:24:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:24:40.452832 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:40.453842 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 15:24:40.454246 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 37/73] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:24:40.600292 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:24:40.600927 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell1:SELECT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:24:40.601557 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=8 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:24:40.652455 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:40.654980 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:24:40.654980 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: warnings.warn(msg) Aug 24 15:24:40.656486 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:40.656958 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:40.657386 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:40.658103 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:40.658573 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:40.659513 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:40.685757 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-0f159b2d-1704-4148-a8ab-514f96007031 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090434 Aug 24 15:24:40.686355 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 37/74] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 15:24:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:24:41.526020 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: DEBUG nova.api.openstack.wsgi [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] Calling method '>' {{(pid=105661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:41.527184 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: INFO nova.api.openstack.requestlog [None req-993610cb-0fa3-4dbe-8273-611d11fb096b admin admin] 10.222.0.76 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Aug 24 15:24:41.527599 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: [pid: 105661|app: 0|req: 38/75] 10.222.0.76 () {56 vars in 1074 bytes} [Wed Aug 24 15:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:24:41.730391 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:24:41.732761 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 15:24:41.732761 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: warnings.warn(msg) Aug 24 15:24:41.733856 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:41.734366 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:41.734804 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:41.735512 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:24:41.735946 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:24:41.736352 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:24:41.757714 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-c4e8a52e-dfae-412a-b0ee-e8560ef1a805 admin admin] 10.222.0.76 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086107 Aug 24 15:24:41.758294 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 38/76] 10.222.0.76 () {60 vars in 1193 bytes} [Wed Aug 24 15:24:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:25:39.456868 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: Wed Aug 24 15:25:39 2022 - graceful shutdown triggered... Aug 24 15:25:39.456327 dv-cinder-848900-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 15:25:39.457954 dv-cinder-848900-6-iscsi devstack@n-api.service[105660]: Gracefully killing worker 1 (pid: 105660)... Aug 24 15:25:39.458376 dv-cinder-848900-6-iscsi devstack@n-api.service[105661]: Gracefully killing worker 2 (pid: 105661)... Aug 24 15:25:40.457480 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: worker 1 buried after 1 seconds Aug 24 15:25:40.457480 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: worker 2 buried after 1 seconds Aug 24 15:25:40.457480 dv-cinder-848900-6-iscsi devstack@n-api.service[105659]: goodbye to uWSGI. Aug 24 15:25:40.459103 dv-cinder-848900-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 15:25:40.459705 dv-cinder-848900-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 15:25:40.462686 dv-cinder-848900-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 15:25:40.476156 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 15:25:40 2022] *** Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: nodename: dv-cinder-848900-6-iscsi Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: machine: x86_64 Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: clock source: unix Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: pcre jit disabled Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: detected number of CPU cores: 4 Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: current working directory: / Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: detected binary path: /usr/bin/uwsgi-core Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: your processes number limit is 47680 Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: your memory page size is 4096 bytes Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: detected max file descriptor number: 2048 Aug 24 15:25:40.478390 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: lock engine: pthread robust mutexes Aug 24 15:25:40.479993 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: thunder lock: enabled Aug 24 15:25:40.479993 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 15:25:40.479993 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 15:25:40.520236 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: Python main interpreter initialized at 0x55ff62c2e9c0 Aug 24 15:25:40.520236 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: python threads support enabled Aug 24 15:25:40.520236 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: your server socket listen backlog is limited to 100 connections Aug 24 15:25:40.520236 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: your mercy for graceful operations on workers is 90 seconds Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: *** Operational MODE: preforking *** Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: *** uWSGI is running in multiple interpreter mode *** Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: spawned uWSGI master process (pid: 120836) Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: spawned uWSGI worker 1 (pid: 120848, cores: 1) Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: spawned uWSGI worker 2 (pid: 120849, cores: 1) Aug 24 15:25:40.523160 dv-cinder-848900-6-iscsi devstack@n-api.service[120836]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 15:25:40.521224 dv-cinder-848900-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 15:25:41.206450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:25:41.256410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 15:25:42.372154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:25:42.372154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: from cryptography.utils import int_from_bytes Aug 24 15:25:42.372751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:25:42.372751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: from cryptography.utils import int_from_bytes Aug 24 15:25:42.444216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:25:42.444216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: from cryptography.utils import int_from_bytes Aug 24 15:25:42.444859 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 15:25:42.444859 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: from cryptography.utils import int_from_bytes Aug 24 15:25:44.840225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:25:44.841048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:25:44.841048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:25:44.841413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:25:44.841578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:25:44.841975 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.842353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.842683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.843009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.843522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.843838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.844166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.844491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.845387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.845652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.845974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.846339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-6-iscsi {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.846674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.846989 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.847311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.847658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.847951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.848273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.848793 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.849311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.849773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.850089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.850439 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.850916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.851133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.851693 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.851693 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.852127 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.852331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.852646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.853064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-6-iscsi {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.853395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.853713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.854031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.854501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.854816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.855131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.855460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.855785 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.856100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.856458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.856786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.857112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.857438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.857747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.858062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.858413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.859076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.859076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.863364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.864779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.865422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.865422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.865662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.865987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.866441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.866714 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.867004 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.867344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.867669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.867983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.868308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.868634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.868986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.869257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.869566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.869914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.870324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.870578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.870826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.871131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.875920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.877450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.878619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.880977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.881996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.881996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.881996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.882469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.882611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.882804 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.883124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.883433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.883741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.884052 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.884355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.884680 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.885008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.885322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.885635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.885942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.886327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.886850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.887370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.887893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.888220 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.889105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.889105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.889526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.889526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.889839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.890138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.890576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.890820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.891120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.891952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.892430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.892780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.893007 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.893309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.893628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.893970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.894307 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.894649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.894983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.895304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.895653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.896006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.896326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.896656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.896987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.897302 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.897616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.897931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.898291 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.898634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.898947 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.899269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.899585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.899901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.900215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.900531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.900855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.901196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.901515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.901837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.902154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.902508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.902825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.903138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.903453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.903771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.904081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.904390 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.904704 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.905014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.905340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.905676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.905992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.906617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.906937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.908241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.908241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.908496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.908777 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.909065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.909383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.909696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.910029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.910374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.910691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.911020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.911766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.911919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.915758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.916558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.916558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.916861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.917040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.917256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.917606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.917942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.918278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.918611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.918999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.919293 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.919614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.919938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.920297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.920617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.920932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.921249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.921560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.921893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.922212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.922551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.922899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.923215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.923571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.923892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.924243 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.924592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.924920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.925251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.925561 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.925885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.926198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.926541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.926867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.927183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.927515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.927834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.928566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.928566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.928861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.929130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.929425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.929742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.930061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.930504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.930685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 15:25:44.931255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.931398 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 15:25:44.931528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.931528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.931816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.931953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 15:25:44.932081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.932323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.932634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 15:25:44.932788 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.932951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.933157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 15:25:44.933296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.933564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.934057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.934189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.934607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.934942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.935254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.935579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.935769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.935929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.936198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.936374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.936557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.936726 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.936892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.937147 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.937322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.937469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.937772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.937971 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.938123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.938400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.938568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.938769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.938984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.939135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.939442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.939633 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.939784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.939959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.940145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.940333 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.940505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.940689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.940870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.941092 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-6-iscsi {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.941270 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.941491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.941802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.942003 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.942153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.942441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.942632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.942828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.942975 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.943182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.943384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.943608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.943781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.943945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.944088 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.944313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.944498 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.944648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.944922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.945231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.945540 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.945762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.945925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.946182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.946523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.946699 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.946932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.947120 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.947276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.947736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.947909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.947909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.948238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.948422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.948422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.948727 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.948873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.949065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.949232 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.949451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.949717 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.949874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.949874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.950266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.950431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.950617 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.950801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.950801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.951132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.951312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.951460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.951639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.951787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.951997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.952190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-6-iscsi {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.952372 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.952524 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.952714 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.952906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.953061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.953422 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.953676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.953867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.954759 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.954945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.955101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.955391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.955720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.956054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.956214 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.956393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.956639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.956831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.957030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.957203 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.957398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.957556 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.957738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.957906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.958056 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.958303 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.958464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.958636 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.958849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.959039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.959191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.959456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.959774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.960070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.960326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.960488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.960692 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.960971 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.961130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.961301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.961446 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.961628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.961782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.961980 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.962171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.962397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.962557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.962741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.962906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.963086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.963261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.963458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.963774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.963978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.964192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.964373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.964649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.964833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.965041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.965355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.965665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.965844 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.966028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.966320 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.966635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.966819 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.966988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.967251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.967435 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.967590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.967858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.968048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.968213 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.968392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.968585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.968774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.968932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.969089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.969360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.969511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.969725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.970613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.970811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.970965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.971107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.971284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.971544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.971720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.971894 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.972098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.972274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.972443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.972732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.972941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.973102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.973279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.973426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.973640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.973800 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.974012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.974283 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.974466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.974616 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.974799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.974962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.975147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.975338 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.975735 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.975911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.976140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.976298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.976489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.976680 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.976866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.977020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.977191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.977367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.978263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.978423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.978423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.978753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.76 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.978940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.979099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.76 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.979290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.979483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.979657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.979657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.979971 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.980133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.980133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.980483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.980774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.980954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.981111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.981111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.981423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.981608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.981757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.981936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.981936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.982327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.982487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.982670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.982814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.982988 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.983133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.983133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.983491 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.983677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.983828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.984053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.984053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.984881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.985044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.985227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.985424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.986288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.986494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.986653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.986828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.986828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.987158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.987313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.987313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.987313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.987837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.987985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.987985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.987985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.988460 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.988609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.988778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.988964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.988964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.989251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.989436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.989582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.989756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.989910 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.990086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.990086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.990487 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.990681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.990945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.991093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.991093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.991412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.991586 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.991734 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.991932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.992090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.992266 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.992266 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.992594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.992750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.992929 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.993113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.993113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.993441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.993616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.993762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.993932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.994133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.994402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.994402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.994733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.994915 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.995071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.995224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.995224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.995549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.995744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.995919 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.996103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.996103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.996439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.996591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.996591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.996591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.997187 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.997336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.997336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.997665 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.997871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.998033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.998249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.998249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.998582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.998732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.998732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.999108 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.999273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.999436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:44.999602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.999602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:44.999945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.000821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.000821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.001385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.001569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.001569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.001900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.001900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.002212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.002212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.002601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.002784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.002784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.003106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.003258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.003258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.003546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.003726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.003726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.004072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.004296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.004447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.004637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.004637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.004977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.005158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.005303 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.005452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.005452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.005758 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.005942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.006155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.006427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.006756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.007091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.007321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.007506 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.007706 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.007914 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.008068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.008253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.008426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.008684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.008861 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.009045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.009218 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.009380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.009611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.009794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.010018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.010266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.010462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.010646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.010801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 15:25:45.010984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.011188 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.011457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.011661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.011840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.012024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.012244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.012407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.012551 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.012737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.012887 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.013063 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.013221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.013391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.013560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.013781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.013954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.014130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.014409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.014579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.014757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.014921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.015103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.015282 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.015459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.015665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.015828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.016006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.016272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.017138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.017451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.017780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.017964 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.018174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.018373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.018551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.018713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.018856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.019058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.019238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.019440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.019687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.019868 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.020031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.020293 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.020470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.020665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.020840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.020988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.021231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.021382 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.021682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.021857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.022027 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.022297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.022500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.022500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.022859 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.023033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.023259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.023441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.023602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.023786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.023934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.024103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.024385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.024577 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.024740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.024964 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.025137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.025358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.025523 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.025708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.025898 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.026211 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.026544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.026762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.026938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.027147 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.027474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.028330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.028511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.028669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.029503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.029738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.029738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.030106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.030338 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.030338 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.030660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.030851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.030851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.031165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.031589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.031589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.032142 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.032873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.032873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.033240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.033417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.033417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.033752 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.033907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.034117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.034326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.034326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.034688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.034861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.035055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.035213 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.035213 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.035564 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.035750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.035962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.036885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.037367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.037514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.037665 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.037808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.037808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.038091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.038284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.038466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.038737 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.038898 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.039093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.039253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.039479 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.039632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.039828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.039985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.040173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.040328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.040516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.040762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.040956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.041154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.041328 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.041526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.041711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.041907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.042250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.042445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.042615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.042814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.042814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.043121 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.043313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.043531 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.043702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.043903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.044086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.044244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.044434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.044682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.044859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.045051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.045215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.045404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.045605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.045825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.046012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.046230 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.046446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.046602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.046801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.046952 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.047130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.047376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.047576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.047817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.047982 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.048166 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.048317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.048543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.048753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.048753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.049064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.049242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.049242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.049573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.049736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.049947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.050121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.050343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.050542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.050699 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.050878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051091 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051245 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051760 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.051940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.052369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.052546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.052755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.052950 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.053114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.053270 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.053458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.053624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.053870 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.054067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.054271 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.054473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.054688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.054882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.055038 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.055246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.055406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.055594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.055777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.055777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.056125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.056317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.056534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.057344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.057561 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.057745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.057938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.057938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.058310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.058484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.058701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.058912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.059071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.059251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.059418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.059598 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.059764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.059949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.060138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.060324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.060324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.060666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.060839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.060839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.061184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.061336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.061336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.061651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.061839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.061992 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.062183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.062395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.062685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.062874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.063041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.063222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.063958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.063958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.064338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.064504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.064695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.064904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.065106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.065347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.065540 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.065728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.065882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.066052 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.066312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.066524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.066688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.066880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.067057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.067228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.067388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.067593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.067768 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.067956 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.068112 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.068288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.068288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.068637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.068834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.068993 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.069176 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.069326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.069518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.069684 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.069873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.070031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.070242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.070410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.070599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.070753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.070950 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.071126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.071340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.071340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.071685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.071862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.071862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.072210 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.072376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.072557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.072855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.073052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.073228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.073413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.073599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.073599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.073898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.074093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.074093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.074093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.074646 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.074864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.075022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.075217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.075412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.075602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.075766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.075946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.076166 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.076346 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.076528 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.076720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.076883 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.077055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.077055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.077397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.077555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.077730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.077899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.078095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.078327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.078327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.078647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.078838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.078838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.079783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.079984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.079984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.080311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.080466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.080659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.080852 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.080852 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.081180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.081368 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.081368 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.081722 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.081904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.081904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.082253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.082432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.082432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.082770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.083048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.083048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.083423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.083593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.083593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.083934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.084119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.084119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.084453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.084646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.084646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.085010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.085174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.085174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.085513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.085701 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.085701 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.086029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.086232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.086232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.086588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.086778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.086778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.087101 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.087304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.088177 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.088365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.088365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.088714 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.088891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.088891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.089239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.089416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.089416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.089762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.089942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.090105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.090427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.090597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.090808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.090808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.091140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.091313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.091496 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.091660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.092157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.092365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.092521 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.092718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.092718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.093079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.093357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.093553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.093708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.093885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.094040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.094266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.094451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.094658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.094830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.094830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.095202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.095396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.095553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.095727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.095931 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.096093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.096279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.096447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.096447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.096780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.096937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.097215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.097418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.097574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.097760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.097916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.098116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.098353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.098522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.098709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.098873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.099052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.099216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.099407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.099574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.099746 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.099937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.100116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.100292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.100494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.100661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.100849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.101047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.101230 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.101380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.101579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.101737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.101928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.102087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.102316 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.102514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.102684 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.102878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.103033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.103222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.103531 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.103693 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.103693 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.104046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.104204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.104387 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.104563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.104563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.104910 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.105071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.105300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.105458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.105632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.105865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.106023 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.106208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.106414 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.106564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.106743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.106939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.107123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.107303 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.107540 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.107693 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.107874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.108025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.108247 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.108421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.108608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.108767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.108925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.109105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.109296 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.109492 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.109680 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.109853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.110037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.110254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.110456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.110656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.110837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.111001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.111197 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.112010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.112207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.112372 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.112559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.112731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.112911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.113070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.113274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.113451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.113719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.113903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.114055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.114292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.114459 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.114639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.114817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.115009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.115222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.115431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.115601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.115787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.115998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.116361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.117759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.119374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.120763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.122105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.123468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.123468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.123468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.123468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.123468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.124383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.124383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.124383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.124995 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.124995 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.125386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.125561 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.126402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.126743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.127208 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.127649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.127649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.128476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.128476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.129393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.129393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.129393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.129884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.130033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.130325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.130698 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.131018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.131473 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.131811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.132138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.132463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.132786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.133100 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.133429 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.133754 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.134077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.134419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.134738 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.135065 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.135415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.135705 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.136036 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.136365 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.136696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.137008 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.137327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.137643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.138255 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.138441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.138634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.138901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.139224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.139587 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.139887 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.140215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.140529 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.140846 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.141167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.142173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.142960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.142960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.144181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.144181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.144181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.144181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.145648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.145648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.145648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.145648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.145648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.149239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.151499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.152879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.152879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.152879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.152879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.152879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.153672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.153672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.153672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.154756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.154756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.154756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.155339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.155339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.155738 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.155895 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.156557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.156895 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.157755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.158083 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.158423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.158757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.159090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.159418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.159751 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.160186 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.160519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.160838 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.161171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.161507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.162099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.162444 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.162766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.163084 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.163408 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.163739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.164054 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.164404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.164685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.165004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.165317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.165628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.165959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.167202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.167202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.167701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.167701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.168037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.168227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.168531 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.168932 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.169167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.169563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.169791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.170279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.170471 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.170770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.171106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.171447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.171797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.172156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.172475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.173423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO dbcounter [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Registered counter for database nova_api Aug 24 15:25:45.173638 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.174019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.174019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.174786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.174786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.175490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.175490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.175490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.176147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.176147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.176397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.176702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.177011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.177343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.177655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.177984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.178515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.178638 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.178938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.179249 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.179599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.179915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.180262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.180578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.180908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.181235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.181559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.181885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.183239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.183239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.183239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.183239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.183239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.183239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.184197 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.184410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.184978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.185317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.185639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.185959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.186304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.186630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.186954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.187270 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.187588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.187907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.188517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.188909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.188909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.189266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.189734 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.189892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.190214 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.192977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.193724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.193724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.193724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.193724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.194430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.194566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_db.sqlalchemy.engines [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.194700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.194700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.194921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.195235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.195686 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.195820 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.196850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.196850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.196850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.197453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.197609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.197922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.198591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.198591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.199043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.199268 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.199564 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.199888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.200214 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.200543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.200848 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.201165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.201477 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.201806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.202130 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.202472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.202793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.203113 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.203547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writer thread running {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.203752 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.204140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.204464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.204800 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.205133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.205487 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.205774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.206262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.206449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.206765 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.207091 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.207411 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.207722 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.208033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.208362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.208678 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.208992 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.209311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.209622 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.209958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.210302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.210618 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.210929 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.211250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.211562 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.211875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.212185 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.212732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.213264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.213589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.213992 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.214431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.215016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.215462 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.215791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.216111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.216576 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.216900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.217279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.217606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.217928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.218289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.218619 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.218947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.219310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.220152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.220732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.221076 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.221406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.221752 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.222091 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.222438 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.222747 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.223059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.223393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.223718 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.224038 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.224355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.224677 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.224995 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.225311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.225630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.225948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.226392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.226606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.226926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.227241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.228377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.228710 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.229047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.229407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.229745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.230077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.231366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.231712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.232048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.232377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.232705 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.233032 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.233366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.233801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.234136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.234568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.235016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.235406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.235888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.236078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.236400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.236733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.237066 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.237389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.237721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.238044 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.238418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.238774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.239114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.239453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.239767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.240081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.240395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.240720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.241050 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.241366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.241679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.241991 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.242332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.242647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.242959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.243274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.243587 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.243903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.244212 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.244525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.244834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.245144 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.245455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.245766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.246080 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.246417 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.246732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.247047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.247360 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.247672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.248016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.248360 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.248714 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.249364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.249364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.254923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.255565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.255565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.255820 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.256146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.256464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.256801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.257126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.257441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.257758 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.258074 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.258434 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.258758 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.259076 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.259393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.259716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.260042 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.260375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.260713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.261890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.261890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.261890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.262448 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.262448 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.262717 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.263024 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.263343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.263663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.263977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 15:25:45.264224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 15:25:45.268495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.context [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fabf33d6-d538-4599-b25e-492b9bb37677(cell1) {{(pid=120849) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:25:45.273542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:25:45.273542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:25:45.273542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:25:45.273542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:25:45.274766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:25:45.275724 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:25:45.277946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO dbcounter [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Registered counter for database nova_cell0 Aug 24 15:25:45.282899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO dbcounter [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Registered counter for database nova_cell1 Aug 24 15:25:45.293038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_db.sqlalchemy.engines [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.293829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_db.sqlalchemy.engines [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.301159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writer thread running {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.303019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writer thread running {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.331809 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO dbcounter [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Registered counter for database nova_api Aug 24 15:25:45.353803 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_db.sqlalchemy.engines [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.362150 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writer thread running {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.420414 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.context [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fabf33d6-d538-4599-b25e-492b9bb37677(cell1) {{(pid=120848) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 15:25:45.425178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:25:45.425670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:25:45.427353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:25:45.428149 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:25:45.428637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:25:45.430722 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:25:45.432812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO dbcounter [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Registered counter for database nova_cell0 Aug 24 15:25:45.437034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO dbcounter [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Registered counter for database nova_cell1 Aug 24 15:25:45.447067 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_db.sqlalchemy.engines [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.452103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_db.sqlalchemy.engines [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.452784 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writer thread running {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.463795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO dbcounter [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Registered counter for database nova_cell0 Aug 24 15:25:45.472711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_db.sqlalchemy.engines [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.477725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writer thread running {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.610043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writer thread running {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.621107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO dbcounter [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Registered counter for database nova_cell0 Aug 24 15:25:45.631282 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_db.sqlalchemy.engines [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 15:25:45.636680 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writer thread running {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 15:25:45.801075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: WARNING keystonemiddleware.auth_token [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:25:45.808434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: WARNING keystonemiddleware.auth_token [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:25:45.959513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: WARNING keystonemiddleware.auth_token [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:25:45.967182 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: WARNING keystonemiddleware.auth_token [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:25:46.148554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: WARNING keystonemiddleware.auth_token [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:25:46.155055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: WARNING keystonemiddleware.auth_token [None req-45e0cd17-51fa-4162-9ac1-027492dc0a17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:25:46.161578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff62c2e9c0 pid: 120849 (default app) Aug 24 15:25:46.313386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: WARNING keystonemiddleware.auth_token [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 15:25:46.319542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: WARNING keystonemiddleware.auth_token [None req-76efa05e-c68a-493f-81eb-6a51e767d9bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 15:25:46.324858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff62c2e9c0 pid: 120848 (default app) Aug 24 15:26:23.414276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.415789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.416614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.417386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.620186 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.621674 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.622793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:23.623842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:25.056401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-15c84a14-219f-4626-8629-aeb5307b01d4 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Action: 'create', calling method: .version_select at 0x7f665b2e9940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1703926343"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:25.358242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e04674e5-95c4-4612-b7b4-cbb9f6849259 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Action: 'create', calling method: .version_select at 0x7f665b2e88b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1512304847", "metadata": {"Type": "work"}}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:28.020118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-15c84a14-219f-4626-8629-aeb5307b01d4 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.622985 Aug 24 15:26:28.021811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 1/1] 10.222.0.76 () {60 vars in 1155 bytes} [Wed Aug 24 15:26:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4626 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 15:26:28.030172 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d01903dd-7a03-4cb2-877d-521de738d04e tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f665b140790>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:28.346826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d01903dd-7a03-4cb2-877d-521de738d04e tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/ed8d6bcf-3eff-4584-83fc-106cdad8e770" status: 200 len: 349 microversion: 2.1 time: 0.323494 Aug 24 15:26:28.348103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 2/2] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:28 2022] GET /compute/v2.1/os-volumes/ed8d6bcf-3eff-4584-83fc-106cdad8e770 => generated 349 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:28.353497 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-40e874a7-0e17-4814-897b-373cd1e7aa9b tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b140ee0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:28.501836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e04674e5-95c4-4612-b7b4-cbb9f6849259 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.888246 Aug 24 15:26:28.503439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 1/3] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 15:26:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4891 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 15:26:28.529254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a07eaae9-c99f-49c1-b508-afc1589d159d tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b140700>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:29.029961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-40e874a7-0e17-4814-897b-373cd1e7aa9b tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 346 microversion: 2.1 time: 0.680650 Aug 24 15:26:29.030545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 3/4] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:28 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 346 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:29.044356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-deafa827-c100-4292-aea1-584c534165b7 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Action: 'create', calling method: .version_select at 0x7f665b155550>, body: {"snapshot": {"volume_id": "94fd5277-54e7-4908-8a02-9249e316dac2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-225525953"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:29.124138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a07eaae9-c99f-49c1-b508-afc1589d159d tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 354 microversion: 2.1 time: 0.599677 Aug 24 15:26:29.125240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 2/5] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:28 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 354 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:29.138190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-232009a6-6053-4f99-a42d-98396f9d7231 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b140dc0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:29.590330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-232009a6-6053-4f99-a42d-98396f9d7231 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 354 microversion: 2.1 time: 0.456213 Aug 24 15:26:29.602613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 3/6] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:29 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 354 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:29.629814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3cef586c-777f-41fa-8d75-0b8ad76ab75b tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b1544c0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:30.025086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-deafa827-c100-4292-aea1-584c534165b7 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.985254 Aug 24 15:26:30.033207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 4/7] 10.222.0.76 () {60 vars in 1162 bytes} [Wed Aug 24 15:26:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:30.038275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-daaa0bca-2972-4a1e-92c7-b4cb39d7e2e7 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b155ca0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:30.142896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-daaa0bca-2972-4a1e-92c7-b4cb39d7e2e7 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.108029 Aug 24 15:26:30.143971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 5/8] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:30 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:30.158495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bea40fb2-9985-489b-8fc0-288c5e639c7c tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b155430>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:30.245364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3cef586c-777f-41fa-8d75-0b8ad76ab75b tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 202 len: 0 microversion: 2.1 time: 0.633788 Aug 24 15:26:30.246665 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 4/9] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:26:29 2022] DELETE /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:26:30.257289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7120a666-2d68-4571-bf73-ea89c160c33d tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b140af0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:30.314493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bea40fb2-9985-489b-8fc0-288c5e639c7c tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.161596 Aug 24 15:26:30.321697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 6/10] 10.222.0.76 () {58 vars in 1140 bytes} [Wed Aug 24 15:26:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:30.329419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-14e50520-f8cb-4e7a-9c69-964964d02ae4 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b1610d0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:30.390592 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7120a666-2d68-4571-bf73-ea89c160c33d tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.138062 Aug 24 15:26:30.392440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 5/11] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:30 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:30.453702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-14e50520-f8cb-4e7a-9c69-964964d02ae4 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.130769 Aug 24 15:26:30.454833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 7/12] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:30 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:30.848470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e9f9386d-0419-42b7-b9c8-2b54c41ac7c6 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f665b1404c0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:30.997083 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e9f9386d-0419-42b7-b9c8-2b54c41ac7c6 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/d8711b86-1b3e-4e74-b1b3-bd42015a7edc" status: 200 len: 351 microversion: 2.1 time: 0.156187 Aug 24 15:26:30.999037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 6/13] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:30 2022] GET /compute/v2.1/os-volumes/d8711b86-1b3e-4e74-b1b3-bd42015a7edc => generated 351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:31.404579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-67e5fb0e-0ec3-41e6-9bb7-b482b3cc2e99 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b140670>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:31.470108 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8fd25f8a-58ee-43b2-9179-2a7f3d937d42 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b1541f0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:31.509661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-67e5fb0e-0ec3-41e6-9bb7-b482b3cc2e99 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.109456 Aug 24 15:26:31.510491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 8/14] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:31 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:31.587209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8fd25f8a-58ee-43b2-9179-2a7f3d937d42 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.122044 Aug 24 15:26:31.590729 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 7/15] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:31 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:32.522669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2bca8bb5-87cf-46ab-bdf8-3d5149db94fe tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b140e50>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:32.603400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-07363bd9-e23f-40bf-b245-4dce90b21b43 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b1405e0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:32.677765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2bca8bb5-87cf-46ab-bdf8-3d5149db94fe tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.158878 Aug 24 15:26:32.678569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 9/16] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:32 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:32.728397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-07363bd9-e23f-40bf-b245-4dce90b21b43 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.129248 Aug 24 15:26:32.729952 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 8/17] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:32 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:33.692678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4fa0220c-b567-4733-b307-85aa9188e74f tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b1554c0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:33.815952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4fa0220c-b567-4733-b307-85aa9188e74f tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.127800 Aug 24 15:26:33.817095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 10/18] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:33 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:33.822906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-18d23811-c63b-4c27-945f-3d359956ae13 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b140ca0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:34.037370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-18d23811-c63b-4c27-945f-3d359956ae13 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.218999 Aug 24 15:26:34.038066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 11/19] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:33 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:34.098526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c261a9ce-d58c-49dd-90d9-20d82294076c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'create', calling method: .version_select at 0x7f665b140af0>, body: {"keypair": {"name": "tempest-keypair-1947463283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoJUTMnDar1WuJv7otb4zuirBqhdjfBJtYS/8wG082jnYoZVsmQZ3h4kPVm6OxRscAfrWDAmWzltxN6zaWubaoY2nU4TTUE0zNQVK0TJ8lVtcZEMBXlym7zZIl2mANgJA=="}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:34.151817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-c261a9ce-d58c-49dd-90d9-20d82294076c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:26:34.159476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-c261a9ce-d58c-49dd-90d9-20d82294076c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for user 56535a702f4344aa8a58f11406acf4c9 and project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:26:34.237276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c261a9ce-d58c-49dd-90d9-20d82294076c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.532683 Aug 24 15:26:34.245878 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 9/20] 10.222.0.76 () {62 vars in 1200 bytes} [Wed Aug 24 15:26:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 538 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 15:26:34.489172 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1323131026", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "networks": [{"uuid": "95007feb-a624-437c-bfb1-d98d72bac54c"}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:34.631082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] validate_networks() for [('95007feb-a624-437c-bfb1-d98d72bac54c', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:26:34.829655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-78ddc77f-b559-4ab3-a1a3-4ce14cfad186 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665b0b6ca0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:34.925709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-78ddc77f-b559-4ab3-a1a3-4ce14cfad186 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.100124 Aug 24 15:26:34.926724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 10/21] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:34 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:35.050609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-39a3f17b-1837-491c-9635-096e89d24732 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a86c3a0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:35.095109 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-39a3f17b-1837-491c-9635-096e89d24732 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.049157 Aug 24 15:26:35.100555 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 11/22] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:35 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:35.940018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d49b65b8-8769-4316-8298-1731daea1d4f tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a86caf0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:36.012041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d49b65b8-8769-4316-8298-1731daea1d4f tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.075574 Aug 24 15:26:36.013174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 12/23] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:35 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:36.064873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:26:36.071098 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:26:36.072779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:26:36.073875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:26:36.075249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:26:36.109660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-eb9d58ae-aa3e-490b-b4d9-3f2b3d8783b3 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665b0b6e50>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:36.110803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:36.112404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:36.113690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:36.116331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:36.117478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:36.119786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:36.229988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Getting quotas for project fd3f4fde69fc4507837f9feb27ceed01. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:26:36.256493 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-eb9d58ae-aa3e-490b-b4d9-3f2b3d8783b3 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 287 microversion: 2.1 time: 0.151346 Aug 24 15:26:36.257466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 13/24] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:36 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:36.260381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Getting quotas for user b7a4e434c3c74b239c50da6b5d500c23 and project fd3f4fde69fc4507837f9feb27ceed01. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:26:36.276302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-751520ee-b253-45f7-875f-a498ceed4295 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a86ce50>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:36.284347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:26:36.289952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:26:36.403096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-751520ee-b253-45f7-875f-a498ceed4295 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "DELETE /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 202 len: 0 microversion: 2.1 time: 0.133953 Aug 24 15:26:36.403972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 14/25] 10.222.0.76 () {58 vars in 1254 bytes} [Wed Aug 24 15:26:36 2022] DELETE /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:26:36.417472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4b0e7711-3eb8-4f34-98af-3b6c1b06b4b9 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a86c670>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:36.504885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4b0e7711-3eb8-4f34-98af-3b6c1b06b4b9 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.092975 Aug 24 15:26:36.505582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 15/26] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:36 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:36.530541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3591d92c-e748-491c-9683-064b72ca0116 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.116612 Aug 24 15:26:36.532128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 12/27] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:26:36.544608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d875ee2a-e340-48ee-98c6-224bcb8d3f9f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:36.545322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d875ee2a-e340-48ee-98c6-224bcb8d3f9f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:36.748427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d875ee2a-e340-48ee-98c6-224bcb8d3f9f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:36.767345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d875ee2a-e340-48ee-98c6-224bcb8d3f9f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1215 microversion: 2.1 time: 0.227548 Aug 24 15:26:36.778675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 16/28] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:36 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:26:36.897021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2145415190", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db7ab943-70b8-4787-bf6b-c7f7cf735153"}], "security_groups": [{"name": "tempest-securitygroup--1762535839"}], "key_name": "tempest-keypair-1947463283", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:37.029190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-95ec30f1-010e-4d67-bd10-3f6c53b3138a tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a8a74c0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:37.070628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] validate_networks() for [('db7ab943-70b8-4787-bf6b-c7f7cf735153', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:26:37.109081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-95ec30f1-010e-4d67-bd10-3f6c53b3138a tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.085448 Aug 24 15:26:37.111071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 17/29] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:37 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:37.519515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-160d4c01-2a10-4dd3-898d-532a313e1663 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a83baf0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:37.569024 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-160d4c01-2a10-4dd3-898d-532a313e1663 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.055313 Aug 24 15:26:37.569667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 18/30] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:37 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:37.651885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:26:37.652718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:26:37.653324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:26:37.653868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:26:37.654447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:26:37.665483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:37.666029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:37.666690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:37.671663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:37.672235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:37.672684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:37.697049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:26:37.703757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for user 56535a702f4344aa8a58f11406acf4c9 and project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:26:37.721102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:26:37.723748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:26:37.791195 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-71e36cf8-169e-415b-ac08-cbecda4137ba tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:37.792033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-71e36cf8-169e-415b-ac08-cbecda4137ba tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:37.792978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bc757942-c949-4562-adaf-80684f905870 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.907540 Aug 24 15:26:37.798718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 13/31] 10.222.0.76 () {62 vars in 1188 bytes} [Wed Aug 24 15:26:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 15:26:37.810427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-db5de307-6ac4-4da6-a88f-3ca118e0d4c0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:37.811044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-db5de307-6ac4-4da6-a88f-3ca118e0d4c0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:37.917879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-71e36cf8-169e-415b-ac08-cbecda4137ba tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:37.927597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-71e36cf8-169e-415b-ac08-cbecda4137ba tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1215 microversion: 2.1 time: 0.140527 Aug 24 15:26:37.928788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 19/32] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:37 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:37.994876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-db5de307-6ac4-4da6-a88f-3ca118e0d4c0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:38.013324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-db5de307-6ac4-4da6-a88f-3ca118e0d4c0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:38.015294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-db5de307-6ac4-4da6-a88f-3ca118e0d4c0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:38.016726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-db5de307-6ac4-4da6-a88f-3ca118e0d4c0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1282 microversion: 2.20 time: 0.210138 Aug 24 15:26:38.017751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 14/33] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:37 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:38.125733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c6fd5110-0838-49fb-9257-7ffe389ce1a4 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a86caf0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:38.198598 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c6fd5110-0838-49fb-9257-7ffe389ce1a4 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.077637 Aug 24 15:26:38.202664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 20/34] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:38 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:38.581834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0001646b-4d2e-414e-a6e3-6d593eeb1e23 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659fad820>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:38.628739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0001646b-4d2e-414e-a6e3-6d593eeb1e23 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.050135 Aug 24 15:26:38.629861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 15/35] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:38 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:38.951148 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:38.951763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:38.958740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:38.959235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:38.959701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:38.960397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:38.960849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:38.961272 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:39.040963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:39.041500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:39.050103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:39.050616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:39.051210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:39.052066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:39.052518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:39.052936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:39.188684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:39.201258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:39.202985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:39.204497 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:39.205593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7adf6c9c-a065-403d-8a0d-b4a69f65992d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1286 microversion: 2.20 time: 0.168868 Aug 24 15:26:39.206145 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 16/36] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:39 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:39.212558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2ed7ea4f-43c7-44fa-a883-372832a34796 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659f3c3a0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:39.213574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9726770a-e730-4a65-8c12-ffcc3689239c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1219 microversion: 2.1 time: 0.266427 Aug 24 15:26:39.214127 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 21/37] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:38 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:39.260164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2ed7ea4f-43c7-44fa-a883-372832a34796 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.051040 Aug 24 15:26:39.260718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 17/38] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:39 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:39.641309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-985b13a3-18d1-4f8b-b7c3-994c40a9d36f tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a7be700>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:39.670840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-985b13a3-18d1-4f8b-b7c3-994c40a9d36f tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.033837 Aug 24 15:26:39.675503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 22/39] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:39 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:40.231077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:40.231840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:40.235180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:40.235806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:40.239343 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:40.239915 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:40.240437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:40.241245 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:40.241788 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:40.242298 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:40.242439 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:40.242719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:40.243155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:40.243860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:40.244322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:40.244747 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:40.310036 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:40.314959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:40.321800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:40.323586 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:40.324124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b69fb35b-c571-4698-9a99-629e08432773 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1219 microversion: 2.1 time: 0.093110 Aug 24 15:26:40.324685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-78d4f9aa-a05d-4128-80d1-e390c1908e26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1286 microversion: 2.20 time: 0.098227 Aug 24 15:26:40.324808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 23/40] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:40 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:26:40.325753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 18/41] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:40 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:40.336644 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f9041da2-e828-4b1d-8ccf-a64a972065b1 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a844310>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:40.403580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f9041da2-e828-4b1d-8ccf-a64a972065b1 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.077830 Aug 24 15:26:40.404293 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 24/42] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:40 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:40.684127 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-85a55bdc-d2dc-42a2-8078-cbd2501d7835 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659f3c940>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:40.715322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-85a55bdc-d2dc-42a2-8078-cbd2501d7835 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.035656 Aug 24 15:26:40.715900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 19/43] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:40 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:41.344719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:41.345332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:41.348072 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:41.348685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:41.351740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:41.352217 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:41.352647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:41.353334 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:41.353810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:41.354245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:41.354485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:41.355820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:41.355820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:41.356143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:41.356594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:41.357017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:41.423218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:41.423936 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:41.432032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:41.433610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:41.433964 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-adb5a40b-9546-45d5-a4e7-dc3a9e0ab73d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1275 microversion: 2.1 time: 0.093593 Aug 24 15:26:41.434577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 25/44] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:41 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:41.434733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c6e1229b-4658-4ccc-8dc2-1e3577e13be0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1352 microversion: 2.20 time: 0.090464 Aug 24 15:26:41.435455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 20/45] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:41 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:41.439172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-34a9c0b4-210d-480c-bea5-13cefd781321 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a77b3a0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:41.486661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-34a9c0b4-210d-480c-bea5-13cefd781321 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.051017 Aug 24 15:26:41.487305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 26/46] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:41 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:41.727944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b9453e10-eee1-4f97-94ae-700b5b307d3d tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659eef670>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:41.762463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b9453e10-eee1-4f97-94ae-700b5b307d3d tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.038100 Aug 24 15:26:41.763032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 21/47] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:41 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:42.459514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:42.460505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:42.461085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:42.461265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:42.468322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:42.468810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:42.469021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:42.469330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:42.469566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:42.469900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:42.470095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:42.470513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:42.470757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:42.470944 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:42.471214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:42.471645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:42.536223 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:42.538430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:42.543674 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7f452b0d-2253-49e3-8f92-69a074a2dad7 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1275 microversion: 2.1 time: 0.091567 Aug 24 15:26:42.544251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 27/48] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:42 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:42.549476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8f62f1c0-2fa4-4189-98d2-20c7b682713a tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a77b9d0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:42.551965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:42.554421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:42.556107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-38a193e7-89fb-4c21-a22b-60bfe0f1ee93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1352 microversion: 2.20 time: 0.102765 Aug 24 15:26:42.556755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 22/49] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:42 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:42.600244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8f62f1c0-2fa4-4189-98d2-20c7b682713a tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.054959 Aug 24 15:26:42.600845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 28/50] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:42 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:42.775726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-91c00974-2dc4-4148-8adb-dc4747876e77 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659eef3a0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:42.805964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-91c00974-2dc4-4148-8adb-dc4747876e77 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.033980 Aug 24 15:26:42.806566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 23/51] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:42 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:43.564265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:43.564867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:43.576892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:43.578081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:43.578545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:43.579241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:43.579696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:43.580116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:43.580207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:43.580843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:43.587471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:43.587946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:43.588381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:43.589066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:43.589514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:43.589932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:43.643176 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:43.652789 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-207a6572-e6d3-4259-bd80-b5d8989eaa18 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1275 microversion: 2.1 time: 0.092286 Aug 24 15:26:43.653514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 29/52] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:43 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:43.658277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:43.660081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2bfc6395-ae6d-4f5d-9e32-430bce2f6735 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a77be50>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:43.666950 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:43.668906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:43.670158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ad9bd465-12cd-4d1c-9977-0f3f8c280a51 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1352 microversion: 2.20 time: 0.094339 Aug 24 15:26:43.670964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 24/53] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:43 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:43.720984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2bfc6395-ae6d-4f5d-9e32-430bce2f6735 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.066512 Aug 24 15:26:43.721662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 30/54] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:43 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:43.819080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c4bf2e4a-2f37-4e7f-af6d-fabcce0906a3 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659f3cc10>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:43.850067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c4bf2e4a-2f37-4e7f-af6d-fabcce0906a3 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.034845 Aug 24 15:26:43.851065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 25/55] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:43 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:44.674468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:44.675090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:44.684080 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:44.684575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:44.685016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:44.685723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:44.686184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:44.686669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:44.693233 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:44.693864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:44.700795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:44.701277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:44.701709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:44.702507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:44.702958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:44.703384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:44.757281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:44.784426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6687e9cf-92f8-4929-89f5-5ef3fd64d3c0 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1275 microversion: 2.1 time: 0.097813 Aug 24 15:26:44.785496 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 31/56] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:44 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:44.807952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:44.810030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9ff6bf7f-5bb1-40b8-818d-4b9fdebfe81c tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a77b820>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:44.833533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:44.840254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:44.844402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5cfe1f40-acf6-4a43-b2fa-24c0d2925a93 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1352 microversion: 2.20 time: 0.155160 Aug 24 15:26:44.846149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 26/57] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:44 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:44.864057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e6e25928-6faa-4977-a1c2-b5d43da32776 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659eef670>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:44.901481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9ff6bf7f-5bb1-40b8-818d-4b9fdebfe81c tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.114822 Aug 24 15:26:44.902047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 32/58] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:44 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:44.912813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e6e25928-6faa-4977-a1c2-b5d43da32776 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 200 len: 286 microversion: 2.1 time: 0.052440 Aug 24 15:26:44.913597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 27/59] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:44 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:45.820186 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:45.821572 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:45.834476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:45.836525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:45.838344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:45.840646 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:45.842211 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:45.843481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:45.883239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:45.890102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:45.921952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:45.922846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:45.925247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:45.926321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:45.933008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:45.933902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:46.094859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:46.116824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:46.123218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:46.127120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-66f442a4-929d-4509-b769-82d94411aa18 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1340 microversion: 2.20 time: 0.257279 Aug 24 15:26:46.127902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 28/60] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:45 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1340 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:46.133544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b23cc535-c644-4368-8edb-6a870b7fdde5 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659eef700>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:46.228168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b23cc535-c644-4368-8edb-6a870b7fdde5 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.097506 Aug 24 15:26:46.229189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 29/61] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:46 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:46.236848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0043f964-d4d4-42c3-a5f0-e8219a23b8bc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659f05ee0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:46.276901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-0043f964-d4d4-42c3-a5f0-e8219a23b8bc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] HTTP exception thrown: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. Aug 24 15:26:46.284959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0043f964-d4d4-42c3-a5f0-e8219a23b8bc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Request method failure captured: Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd HTTP/1.1 Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMfnL2h9p41aZcpCOvbRMlw8GoBYm65uuHU22L3RVYitPwCMASN4d8nvK-bes5ZnlJ7EsVx40dFKMtLVtdpBcDVKSODeePN9ngdLncOZ6xlFX-L-L8HuwuucKVmYoOhq98hxwvRzGBN8FU8cPLLa2RpdEAOTKT1AlzeBeEXNd2yKpI Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:26:46.294802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_77bcbb8b4a9b44299ca3ac710c1fdee7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}] Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 172faa476a6f4d10b11ad91f828a2ae5 Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '9d5e7354-39c9-44aa-b86b-252a7bafd3bd'} Aug 24 15:26:46.296467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. (HTTP 404) (Request-ID: req-1f13ea26-fdb2-4e4c-9cbf-0a785ae89054) Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.297257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:46.298198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 15:26:46.300300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. Aug 24 15:26:46.302153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:46.306739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0043f964-d4d4-42c3-a5f0-e8219a23b8bc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Returning 404 to user: Snapshot 9d5e7354-39c9-44aa-b86b-252a7bafd3bd could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:26:46.311745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2cf337fc-914e-4abf-b515-3b918c6ca5ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1273 microversion: 2.1 time: 0.497673 Aug 24 15:26:46.313426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0043f964-d4d4-42c3-a5f0-e8219a23b8bc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd" status: 404 len: 111 microversion: 2.1 time: 0.082753 Aug 24 15:26:46.321670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 30/62] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:26:46 2022] GET /compute/v2.1/os-snapshots/9d5e7354-39c9-44aa-b86b-252a7bafd3bd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:26:46.324574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 33/63] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:45 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1273 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:46.334932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-729a5a17-0410-4bef-bec8-8b8418fdaffc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659f059d0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:46.438111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-729a5a17-0410-4bef-bec8-8b8418fdaffc tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 202 len: 0 microversion: 2.1 time: 0.114239 Aug 24 15:26:46.439257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 31/64] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:26:46 2022] DELETE /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:26:46.453926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4299df9b-17ee-443e-a7d9-64774057a9e4 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a73ad30>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:46.563904 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4299df9b-17ee-443e-a7d9-64774057a9e4 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.119932 Aug 24 15:26:46.572500 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 34/65] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:46 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:47.099644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-08db979f-b03e-4913-bcbc-d74e9b686aa6 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f6659ef7a60>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.155978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.156595 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:47.185599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:47.186103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:47.186696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:47.196090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:47.196850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:47.197370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:47.208508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-08db979f-b03e-4913-bcbc-d74e9b686aa6 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1a084d8b-dade-4440-b43f-bb76cbcd71fa" status: 200 len: 350 microversion: 2.1 time: 0.111496 Aug 24 15:26:47.213376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 32/66] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes/1a084d8b-dade-4440-b43f-bb76cbcd71fa => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:47.221911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fdd523e8-e8eb-4dd9-9397-4a1c6343c585 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f6659eaa550>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.419416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fdd523e8-e8eb-4dd9-9397-4a1c6343c585 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.201528 Aug 24 15:26:47.419973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 33/67] 10.222.0.76 () {58 vars in 1134 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:47.427662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f3fc2d8f-3751-424c-accd-59f68bce9acf tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659f05e50>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.535618 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:47.544430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:47.548284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:47.550339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2a2323a3-fabb-4c63-bd9f-41b999ff8181 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.399118 Aug 24 15:26:47.551214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f3fc2d8f-3751-424c-accd-59f68bce9acf tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.129901 Aug 24 15:26:47.552230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 34/68] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:47.560727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.561579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:47.568949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:47.569674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:47.570288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:47.571151 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:47.571984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:47.572559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:47.573835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 35/69] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:47.581495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4ecdd93b-fa0f-4611-a5e4-766e8e33127d tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f665a7985e0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.682753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:47.693806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4ecdd93b-fa0f-4611-a5e4-766e8e33127d tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.118695 Aug 24 15:26:47.699998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 36/70] 10.222.0.76 () {58 vars in 1149 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:47.703002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-72d7ab48-1109-4fdc-80f7-131768812fff tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a7859d0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.769413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-72d7ab48-1109-4fdc-80f7-131768812fff tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.073359 Aug 24 15:26:47.770008 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 37/71] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:47.774755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8650733c-9de7-4f19-82bd-ebb5ab90a08e tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f665a77b550>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.815802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:47.824138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-473c0931-a413-475f-b3d0-116d9cbba56c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.270741 Aug 24 15:26:47.824960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 35/72] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:47.864463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8650733c-9de7-4f19-82bd-ebb5ab90a08e tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.093187 Aug 24 15:26:47.865039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 38/73] 10.222.0.76 () {58 vars in 1134 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:47.878380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-40e0e741-e06e-41fc-a17c-f12ca070bfae tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f6659fadca0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:47.960672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-40e0e741-e06e-41fc-a17c-f12ca070bfae tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085973 Aug 24 15:26:47.961225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 36/74] 10.222.0.76 () {58 vars in 1167 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:47.971864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=8 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:47.976028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1b216510-c675-4414-9f35-53f3bda6c7c1 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f665a73a790>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.064244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1b216510-c675-4414-9f35-53f3bda6c7c1 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092741 Aug 24 15:26:48.064913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 39/75] 10.222.0.76 () {58 vars in 1170 bytes} [Wed Aug 24 15:26:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:48.075501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=14 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:48.079479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3d11270b-e60c-4ba1-8d95-d5e7c4da70b8 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f6659e9e550>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.163525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3d11270b-e60c-4ba1-8d95-d5e7c4da70b8 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088626 Aug 24 15:26:48.164164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 37/76] 10.222.0.76 () {58 vars in 1155 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:48.177369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cc3577e4-9810-4df3-9e8c-b98442826da0 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f665a798670>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.264682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cc3577e4-9810-4df3-9e8c-b98442826da0 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091205 Aug 24 15:26:48.265296 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 40/77] 10.222.0.76 () {58 vars in 1188 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:48.277807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-92e4cc37-94e4-497d-8459-e5d5087e2976 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] Calling method '.version_select at 0x7f6659e310d0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.373873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-92e4cc37-94e4-497d-8459-e5d5087e2976 tempest-VolumesTestJSON-1701189068 tempest-VolumesTestJSON-1701189068-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.099732 Aug 24 15:26:48.375027 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 38/78] 10.222.0.76 () {58 vars in 1155 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:48.566092 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-64b6df59-8362-492d-9a5b-4a0343d3cb92 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a7a83a0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.575931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.576544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:48.583321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:48.584043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:48.584232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:48.584932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:48.585377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:48.585798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:48.618133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-64b6df59-8362-492d-9a5b-4a0343d3cb92 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.056622 Aug 24 15:26:48.618981 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 41/79] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:48.718070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:48.726591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:48.728133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:48.729254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f6f00f76-81ad-4181-8cd3-779079553825 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.157557 Aug 24 15:26:48.729800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 39/80] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:48.784001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-326af756-2072-479f-a635-0973666f7aa0 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a7983a0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.844789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:48.845401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:48.856394 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-326af756-2072-479f-a635-0973666f7aa0 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.076663 Aug 24 15:26:48.857053 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 42/81] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:48.861237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:48.861740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:48.862168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:48.863069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:48.866552 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:48.867362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:49.133595 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:49.142402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7dda61c2-b66b-49e0-99b0-a19ae2d5bb78 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.301368 Aug 24 15:26:49.152018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 40/82] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:48 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:49.632594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1360bab5-ce5e-49e1-ae40-202272b32203 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a798670>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:49.682833 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1360bab5-ce5e-49e1-ae40-202272b32203 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.054309 Aug 24 15:26:49.683402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 43/83] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:49 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:49.753000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:49.753762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:49.760310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:49.761011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:49.761445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:49.762136 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:49.762609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:49.763029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:49.871020 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7e70823a-889a-483c-84cb-512acff78c67 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a7a60d0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:49.889502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:49.898500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:49.900013 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:49.901149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f6c1fcb3-7837-45ba-9e30-a803ebec05a6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.153176 Aug 24 15:26:49.906491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 41/84] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:49 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:49.920901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7e70823a-889a-483c-84cb-512acff78c67 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.053571 Aug 24 15:26:49.922104 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 44/85] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:49 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:50.168251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:50.169204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:50.175277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:50.175761 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:50.176192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:50.177072 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:50.177513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:50.177927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:50.326957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:50.335269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5ba3cccc-2817-450e-ade9-1df84b4c5410 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.170867 Aug 24 15:26:50.335828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 42/86] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:50 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:50.697268 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b99f8fa3-a72b-45eb-8682-5fffdee2f21d tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f665a73a820>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:50.757310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b99f8fa3-a72b-45eb-8682-5fffdee2f21d tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.064067 Aug 24 15:26:50.763438 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 45/87] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:50 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:50.924931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:50.925690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:50.934355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:50.935037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:50.935475 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:50.936604 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0185f4c6-1168-4a97-941f-d1087ca42d85 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665bb16b80>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:50.937215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:50.937647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:50.938075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:51.007493 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0185f4c6-1168-4a97-941f-d1087ca42d85 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.075365 Aug 24 15:26:51.012559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 46/88] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:50 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:51.138806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:51.148512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:51.150238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:51.151574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2ab96340-1ad7-45c0-8104-03bd5f31c04c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.230832 Aug 24 15:26:51.152099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 43/89] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:50 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:51.357254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:51.357874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:51.365559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:51.366052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:51.366529 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:51.367264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:51.367751 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:51.368200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:51.540383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:51.548697 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5a3409d0-e958-4c82-994a-5a3b5f880040 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.195297 Aug 24 15:26:51.549371 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 47/90] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:51 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:51.772141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-93501435-5fab-4b99-bf64-45256e5dc991 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659eaab80>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:51.835624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-93501435-5fab-4b99-bf64-45256e5dc991 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.067659 Aug 24 15:26:51.836190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 44/91] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:51 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:52.026579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-80328bb6-eedb-4182-87dd-02114adf098d tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665bb16af0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:52.083017 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-80328bb6-eedb-4182-87dd-02114adf098d tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.060130 Aug 24 15:26:52.083681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 48/92] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:52 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:52.178769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:52.179473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:52.185563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:52.186043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:52.186510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:52.187279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:52.187731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:52.188151 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:52.324676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:52.333308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:52.334845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:52.335983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-06b910db-6ed3-46c8-bd5f-00524e661136 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.161376 Aug 24 15:26:52.336865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 45/93] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:52 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:52.574566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:52.575178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:52.582565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:52.583047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:52.583476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:52.584194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:52.584643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:52.585060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:52.755464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:52.780565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8287d8b7-790c-4fc7-ae30-11fe3bda0fce tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.210394 Aug 24 15:26:52.787005 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 49/94] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:52 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:52.856341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-00990f43-d84e-43d0-99d7-dc8cdf873906 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659ef7940>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:52.912633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-00990f43-d84e-43d0-99d7-dc8cdf873906 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.063386 Aug 24 15:26:52.913281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 46/95] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:52 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:53.101138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-afb62427-157e-4e29-83f2-f2dba5eb9c09 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665bb16dc0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:53.185132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-afb62427-157e-4e29-83f2-f2dba5eb9c09 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.091159 Aug 24 15:26:53.185793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 50/96] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:53 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:53.360421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:53.361281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:53.370332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:53.370907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:53.371285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:53.372083 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:53.372549 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:53.372977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:53.555306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:53.565019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:53.566883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:53.568786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-544ca320-e7e1-47e7-aa72-cefaec7949e3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.212418 Aug 24 15:26:53.575757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 47/97] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:53 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:53.811375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:53.812191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:53.822459 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:53.823063 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:53.823525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:53.824720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:53.825328 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:53.825899 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:53.926821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b4e1fe0a-9768-43f5-bdc7-5ffec3b95c68 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659e9ef70>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:54.006824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b4e1fe0a-9768-43f5-bdc7-5ffec3b95c68 tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 200 len: 353 microversion: 2.1 time: 0.083169 Aug 24 15:26:54.008067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 48/98] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:53 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:54.035933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:54.043884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e9df4947-47c2-4a78-9f77-4c7b90acb15c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.237524 Aug 24 15:26:54.044440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 51/99] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:53 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:54.204085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7cf71cc1-2eac-435b-9f5f-b32014331790 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659e9e040>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:54.262310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7cf71cc1-2eac-435b-9f5f-b32014331790 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 200 len: 345 microversion: 2.1 time: 0.064827 Aug 24 15:26:54.262916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 49/100] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:54 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:26:54.595640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:54.597037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:54.606305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:54.607258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:54.607954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:54.608741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:54.609427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:54.610082 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:54.793603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:54.803715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:54.805432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:54.806661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c83322ed-69b7-4693-81af-326123aaea09 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.216580 Aug 24 15:26:54.807230 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 52/101] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:54 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:55.022941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a9f2ccb9-6074-454f-b8f1-1f05d7de6e8e tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Calling method '.version_select at 0x7f6659e31040>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:55.081263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:55.082303 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:55.089564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-a9f2ccb9-6074-454f-b8f1-1f05d7de6e8e tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] HTTP exception thrown: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a9f2ccb9-6074-454f-b8f1-1f05d7de6e8e tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Request method failure captured: Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 HTTP/1.1 Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMfEl5OeRWpl4fflz-KRQO-mACxybzUoG-y_zB9H-TXhyhILYox8mC7lzNsstRdlThZncYW9_92Amh-ch_CndLAAmNEsXgjzkFk6NKOHzvCNrMVOBXMZryhtUdE8ZXwWS66Dp5U6WV1cV9JWvy-6GfaobLfeZG-rgdztnGyCQOaHYs Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: b8c52f09126b464fae2407602e740b08 Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesGetTestJSON-1978319770 Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:26:55.092766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/b8c52f09126b464fae2407602e740b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8c52f09126b464fae2407602e740b08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_b8c52f09126b464fae2407602e740b08", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/b8c52f09126b464fae2407602e740b08"}]}] Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesGetTestJSON-1978319770 Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: b8c52f09126b464fae2407602e740b08 Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesGetTestJSON-1978319770 Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesGetTestJSON-1978319770-project Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 5c0d72599f8b4f0ab924c11f50b8c3f6 Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesGetTestJSON-1978319770-project Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '1c7565ec-a10b-43d3-9f1c-fba1a6d74c87'} Aug 24 15:26:55.093945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. (HTTP 404) (Request-ID: req-7f6bdb86-fbb4-442b-9053-1b525fd9b41d) Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.094771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:55.095769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:26:55.096978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. Aug 24 15:26:55.097918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.101182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a9f2ccb9-6074-454f-b8f1-1f05d7de6e8e tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] Returning 404 to user: Volume 1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:26:55.103158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a9f2ccb9-6074-454f-b8f1-1f05d7de6e8e tempest-VolumesGetTestJSON-1978319770 tempest-VolumesGetTestJSON-1978319770-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87" status: 404 len: 109 microversion: 2.1 time: 0.085058 Aug 24 15:26:55.104347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 50/102] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:55 2022] GET /compute/v2.1/os-volumes/1c7565ec-a10b-43d3-9f1c-fba1a6d74c87 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:26:55.106816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:55.107535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:55.109217 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:55.110349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:55.111239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:55.111880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:55.283490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e10f0b64-c17c-4c59-a189-2f4b20c81046 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659eaaee0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:55.330330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:55.341607 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2b46da8f-7798-46b1-b120-4b0e9b3adebf tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.264852 Aug 24 15:26:55.343389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 53/103] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:55 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:55.460622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-e10f0b64-c17c-4c59-a189-2f4b20c81046 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] HTTP exception thrown: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e10f0b64-c17c-4c59-a189-2f4b20c81046 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Request method failure captured: Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 HTTP/1.1 Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMfnL2h9p41aZcpCOvbRMlw8GoBYm65uuHU22L3RVYitPwCMASN4d8nvK-bes5ZnlJ7EsVx40dFKMtLVtdpBcDVKSODeePN9ngdLncOZ6xlFX-L-L8HuwuucKVmYoOhq98hxwvRzGBN8FU8cPLLa2RpdEAOTKT1AlzeBeEXNd2yKpI Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:26:55.462897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_77bcbb8b4a9b44299ca3ac710c1fdee7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}] Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 172faa476a6f4d10b11ad91f828a2ae5 Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '94fd5277-54e7-4908-8a02-9249e316dac2'} Aug 24 15:26:55.464039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. (HTTP 404) (Request-ID: req-7ff306cf-50f8-411c-8d84-fffd7365eba6) Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.464737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:55.465906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:26:55.466983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.468544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.471461 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e10f0b64-c17c-4c59-a189-2f4b20c81046 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Returning 404 to user: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:26:55.472904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e10f0b64-c17c-4c59-a189-2f4b20c81046 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 404 len: 109 microversion: 2.1 time: 0.200164 Aug 24 15:26:55.473812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 51/104] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:55 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 109 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:26:55.486463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f6abf9a2-7e9c-4019-8e87-fe9a25d17282 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f665a77b940>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:55.611430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-f6abf9a2-7e9c-4019-8e87-fe9a25d17282 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] HTTP exception thrown: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f6abf9a2-7e9c-4019-8e87-fe9a25d17282 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Request method failure captured: Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 HTTP/1.1 Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkMfnL2h9p41aZcpCOvbRMlw8GoBYm65uuHU22L3RVYitPwCMASN4d8nvK-bes5ZnlJ7EsVx40dFKMtLVtdpBcDVKSODeePN9ngdLncOZ6xlFX-L-L8HuwuucKVmYoOhq98hxwvRzGBN8FU8cPLLa2RpdEAOTKT1AlzeBeEXNd2yKpI Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:26:55.616648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_77bcbb8b4a9b44299ca3ac710c1fdee7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}] Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 172faa476a6f4d10b11ad91f828a2ae5 Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '94fd5277-54e7-4908-8a02-9249e316dac2'} Aug 24 15:26:55.617707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. (HTTP 404) (Request-ID: req-5de0277c-5df9-4422-81a2-44689d46055a) Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.618979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:26:55.619953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:26:55.620867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f6abf9a2-7e9c-4019-8e87-fe9a25d17282 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Returning 404 to user: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f6abf9a2-7e9c-4019-8e87-fe9a25d17282 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 404 len: 109 microversion: 2.1 time: 0.136083 Aug 24 15:26:55.623515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 54/105] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:26:55 2022] DELETE /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:26:55.632568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ee21d5cf-195f-4547-a7b6-ff4e651c8f35 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Calling method '.version_select at 0x7f6659e9e670>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:55.738764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-ee21d5cf-195f-4547-a7b6-ff4e651c8f35 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] HTTP exception thrown: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ee21d5cf-195f-4547-a7b6-ff4e651c8f35 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Request method failure captured: Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 HTTP/1.1 Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMfnL2h9p41aZcpCOvbRMlw8GoBYm65uuHU22L3RVYitPwCMASN4d8nvK-bes5ZnlJ7EsVx40dFKMtLVtdpBcDVKSODeePN9ngdLncOZ6xlFX-L-L8HuwuucKVmYoOhq98hxwvRzGBN8FU8cPLLa2RpdEAOTKT1AlzeBeEXNd2yKpI Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:26:55.742253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_77bcbb8b4a9b44299ca3ac710c1fdee7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/77bcbb8b4a9b44299ca3ac710c1fdee7"}]}] Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 77bcbb8b4a9b44299ca3ac710c1fdee7 Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-875563622 Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 172faa476a6f4d10b11ad91f828a2ae5 Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesSnapshotsTestJSON-875563622-project Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '94fd5277-54e7-4908-8a02-9249e316dac2'} Aug 24 15:26:55.743436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. (HTTP 404) (Request-ID: req-6b96df5d-55af-4d5d-a44c-7ea41ebce1a6) Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.744576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:26:55.746763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:26:55.748295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. Aug 24 15:26:55.751186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:26:55.756445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ee21d5cf-195f-4547-a7b6-ff4e651c8f35 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] Returning 404 to user: Volume 94fd5277-54e7-4908-8a02-9249e316dac2 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:26:55.757596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ee21d5cf-195f-4547-a7b6-ff4e651c8f35 tempest-VolumesSnapshotsTestJSON-875563622 tempest-VolumesSnapshotsTestJSON-875563622-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2" status: 404 len: 109 microversion: 2.1 time: 0.131508 Aug 24 15:26:55.758453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 52/106] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:26:55 2022] GET /compute/v2.1/os-volumes/94fd5277-54e7-4908-8a02-9249e316dac2 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:26:55.835678 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:55.845459 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:55.869313 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:55.873167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:55.874616 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:55.876164 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:55.877147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:55.879238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:56.217218 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:56.242183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:56.244934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:56.250061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3264a874-2964-4e2c-894b-c46467ddb4b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.424215 Aug 24 15:26:56.254544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 55/107] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:55 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:56.368633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:56.372058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:56.404413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:56.407990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:56.409004 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:56.412371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:56.417356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:56.420169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:56.823786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:56.843528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:26:56.850145 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a0ace194-624c-4bee-b147-4beb3e61a338 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.489242 Aug 24 15:26:56.855747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 53/108] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:56 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:57.279581 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:57.282010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:57.291543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:57.292611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:57.293461 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:57.294763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:57.295785 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:57.296743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:57.779704 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:57.804086 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:57.805605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:57.807001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b3efff1e-80f9-4cd4-860b-52d7f2b0c4fb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.532111 Aug 24 15:26:57.808065 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 56/109] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:57 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:26:57.881405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:57.882782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:57.891297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:57.892051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:57.892877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:57.897732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:57.898588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:57.899420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:58.134435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:58.173647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7d28871e-5b81-48a6-b4bc-1bf628d00d07 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.297114 Aug 24 15:26:58.177437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 54/110] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:57 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:26:58.834872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:58.836264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:58.846350 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:58.847230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:58.847913 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:58.848939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:58.849762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:58.850635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:59.025229 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:59.037277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:59.041052 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:59.042941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fdbf2ea5-5767-4b8c-a8e5-ec713cb2f3cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.214482 Aug 24 15:26:59.043876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 55/111] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:26:58 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:26:59.198778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:26:59.199821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:26:59.207622 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12", "tag": "b16b906a-9ef3-40ca-931e-d8ef832c7482"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:26:59.211913 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:59.212441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:59.212835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:59.213543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:59.215086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:59.215411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:59.226079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:59.226875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:59.227328 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:59.250376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Creating event network-changed:b16b906a-9ef3-40ca-931e-d8ef832c7482 for instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 on hv-cinder-84890 Aug 24 15:26:59.251355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120848) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 15:26:59.252218 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-19dd3cd9-5c34-4930-8d03-24933a05584c req-62a433c4-a518-4bd8-b17a-789ee6b114f8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120848) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 15:26:59.253500 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:59.254272 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:59.254898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:59.255816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:26:59.256694 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:26:59.257301 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:26:59.268376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.compute.rpcapi [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 15:26:59.269582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120848) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 15:26:59.293856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1fb71513-0f10-4b45-b2d0-15dd7a2de4c1 None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.476635 Aug 24 15:26:59.294720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 57/112] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:26:59.397489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:26:59.411277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2eba8d08-5eb7-4065-9926-11e26f3d155d tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.216366 Aug 24 15:26:59.413583 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 56/113] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:26:59 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:00.067218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:00.067826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:00.074073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:00.074866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:00.075288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:00.076215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:00.076808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:00.077462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:00.165577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0e661131-6395-4807-abcc-d68b894b4a84 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Action: 'create', calling method: .version_select at 0x7f665a77b310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1493021906", "metadata": {"Type": "work"}}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0e661131-6395-4807-abcc-d68b894b4a84 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Request method failure captured: Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 122 Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkNDxyzFvE02stiRMuaXZBPBUzmUHe_NsExA2uEB68On9hwcCxCQVw1xQqNRTyZMcRJgmwj7g1kruTyhwa9OX-c86pjLfcA9uUZr1bpoVAsQdtDtuEwFlCnkyenvld2-soBVnL69z_CbmqjUNB4EtVT7YdeIGzKMyWqUiOu_leiCj4k Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:27:00.174243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf43b4e2ecb4fa387ad81a4a3a0d7ef", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}] Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 23d64c421a554761babc5522164b7065 Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1493021906", "metadata": {"Type": "work"}}} Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: Aug 24 15:27:00.175463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1493021906', 'metadata': {'Type': 'work'}}}} Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:27:00.176159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:27:00.177287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:27:00.179484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 15:27:00.179484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.180559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0e661131-6395-4807-abcc-d68b894b4a84 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:27:00.181649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0e661131-6395-4807-abcc-d68b894b4a84 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.429635 Aug 24 15:27:00.182909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 58/114] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 15:26:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:27:00.195483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-287023b7-a1ca-4176-a898-d912dbe11430 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Action: 'create', calling method: .version_select at 0x7f665a798940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1929043691", "metadata": {"Type": "work"}}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-287023b7-a1ca-4176-a898-d912dbe11430 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Request method failure captured: Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 120 Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkNDxyzFvE02stiRMuaXZBPBUzmUHe_NsExA2uEB68On9hwcCxCQVw1xQqNRTyZMcRJgmwj7g1kruTyhwa9OX-c86pjLfcA9uUZr1bpoVAsQdtDtuEwFlCnkyenvld2-soBVnL69z_CbmqjUNB4EtVT7YdeIGzKMyWqUiOu_leiCj4k Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:27:00.199656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf43b4e2ecb4fa387ad81a4a3a0d7ef", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}] Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 23d64c421a554761babc5522164b7065 Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1929043691", "metadata": {"Type": "work"}}} Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: Aug 24 15:27:00.200773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1929043691', 'metadata': {'Type': 'work'}}}} Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi '0' Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:27:00.201624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:27:00.202884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:27:00.203817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 15:27:00.203817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.203817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-287023b7-a1ca-4176-a898-d912dbe11430 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:27:00.203817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-287023b7-a1ca-4176-a898-d912dbe11430 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011656 Aug 24 15:27:00.203817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 59/115] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 15:27:00 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:27:00.212100 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4087e238-71be-46b1-9545-a30c01ac25cd tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Action: 'create', calling method: .version_select at 0x7f665a6d2550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1151458825", "metadata": {"Type": "work"}}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4087e238-71be-46b1-9545-a30c01ac25cd tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Request method failure captured: Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 119 Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkNDxyzFvE02stiRMuaXZBPBUzmUHe_NsExA2uEB68On9hwcCxCQVw1xQqNRTyZMcRJgmwj7g1kruTyhwa9OX-c86pjLfcA9uUZr1bpoVAsQdtDtuEwFlCnkyenvld2-soBVnL69z_CbmqjUNB4EtVT7YdeIGzKMyWqUiOu_leiCj4k Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:27:00.216059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf43b4e2ecb4fa387ad81a4a3a0d7ef", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}] Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 23d64c421a554761babc5522164b7065 Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1151458825", "metadata": {"Type": "work"}}} Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: Aug 24 15:27:00.217720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1151458825', 'metadata': {'Type': 'work'}}}} Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise error Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi '' Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:27:00.219666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 15:27:00.222319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 15:27:00.223779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 15:27:00.223779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.223779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4087e238-71be-46b1-9545-a30c01ac25cd tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:27:00.223779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4087e238-71be-46b1-9545-a30c01ac25cd tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009599 Aug 24 15:27:00.223779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 60/116] 10.222.0.76 () {60 vars in 1156 bytes} [Wed Aug 24 15:27:00 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:27:00.228658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0482e0b4-922d-4841-937f-0f05f4196750 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Calling method '.version_select at 0x7f665a6d2dc0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:00.268253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:00.275925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-0482e0b4-922d-4841-937f-0f05f4196750 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] HTTP exception thrown: Volume tempest-invalid-498659256 could not be found. Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0482e0b4-922d-4841-937f-0f05f4196750 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Request method failure captured: Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-498659256 HTTP/1.1 Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkNDxyzFvE02stiRMuaXZBPBUzmUHe_NsExA2uEB68On9hwcCxCQVw1xQqNRTyZMcRJgmwj7g1kruTyhwa9OX-c86pjLfcA9uUZr1bpoVAsQdtDtuEwFlCnkyenvld2-soBVnL69z_CbmqjUNB4EtVT7YdeIGzKMyWqUiOu_leiCj4k Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:27:00.277918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf43b4e2ecb4fa387ad81a4a3a0d7ef", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}] Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 23d64c421a554761babc5522164b7065 Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Volume tempest-invalid-498659256 could not be found. Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': 'tempest-invalid-498659256'} Aug 24 15:27:00.279206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-498659256 could not be found. (HTTP 404) (Request-ID: req-c173a401-a104-4ad2-8572-535d3eb2b2b6) Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.280116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:27:00.281567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-498659256 could not be found. Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:27:00.283392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-498659256 could not be found. Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-498659256 could not be found. Aug 24 15:27:00.284404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.285069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:00.285219 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0482e0b4-922d-4841-937f-0f05f4196750 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Returning 404 to user: Volume tempest-invalid-498659256 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:27:00.285219 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0482e0b4-922d-4841-937f-0f05f4196750 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/tempest-invalid-498659256" status: 404 len: 98 microversion: 2.1 time: 0.055688 Aug 24 15:27:00.285219 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 61/117] 10.222.0.76 () {58 vars in 1215 bytes} [Wed Aug 24 15:27:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-498659256 => generated 98 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:27:00.285584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:00.286901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6b570f3c-da5f-4028-8e83-202c70a5a3ea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.223457 Aug 24 15:27:00.290267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 57/118] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:00 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:00.291691 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-37473d56-284d-47fe-a053-f847e1abc20f tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005317 Aug 24 15:27:00.297039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 62/119] 10.222.0.76 () {58 vars in 1140 bytes} [Wed Aug 24 15:27:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 15:27:00.303004 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2bf1af4a-da6d-4934-a050-98fd560d44d7 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004027 Aug 24 15:27:00.306683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 58/120] 10.222.0.76 () {58 vars in 1137 bytes} [Wed Aug 24 15:27:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 15:27:00.313582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f928c393-99b1-450e-8d68-48df18c8264e tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Calling method '.version_select at 0x7f665a77b280>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:00.347488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-f928c393-99b1-450e-8d68-48df18c8264e tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] HTTP exception thrown: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f928c393-99b1-450e-8d68-48df18c8264e tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Request method failure captured: Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/os-volumes/935f972d-243e-4588-92bb-54229005caf1 HTTP/1.1 Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkNDxyzFvE02stiRMuaXZBPBUzmUHe_NsExA2uEB68On9hwcCxCQVw1xQqNRTyZMcRJgmwj7g1kruTyhwa9OX-c86pjLfcA9uUZr1bpoVAsQdtDtuEwFlCnkyenvld2-soBVnL69z_CbmqjUNB4EtVT7YdeIGzKMyWqUiOu_leiCj4k Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:27:00.349513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf43b4e2ecb4fa387ad81a4a3a0d7ef", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}] Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 23d64c421a554761babc5522164b7065 Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '935f972d-243e-4588-92bb-54229005caf1'} Aug 24 15:27:00.350917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. (HTTP 404) (Request-ID: req-569ad32c-1dd9-4aa4-93bc-30b01c82a463) Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 15:27:00.352513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 15:27:00.354862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f928c393-99b1-450e-8d68-48df18c8264e tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Returning 404 to user: Volume 935f972d-243e-4588-92bb-54229005caf1 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f928c393-99b1-450e-8d68-48df18c8264e tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "DELETE /compute/v2.1/os-volumes/935f972d-243e-4588-92bb-54229005caf1" status: 404 len: 109 microversion: 2.1 time: 0.041939 Aug 24 15:27:00.356554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 63/121] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:27:00 2022] DELETE /compute/v2.1/os-volumes/935f972d-243e-4588-92bb-54229005caf1 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:27:00.365925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3c80c3a7-5d5c-43c3-8ad2-7752d9c3c514 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Calling method '.version_select at 0x7f6659e9e790>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:00.397733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-3c80c3a7-5d5c-43c3-8ad2-7752d9c3c514 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] HTTP exception thrown: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3c80c3a7-5d5c-43c3-8ad2-7752d9c3c514 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Request method failure captured: Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/os-volumes/a2b23860-7457-47c3-82b4-41c730f30c26 HTTP/1.1 Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkNDxyzFvE02stiRMuaXZBPBUzmUHe_NsExA2uEB68On9hwcCxCQVw1xQqNRTyZMcRJgmwj7g1kruTyhwa9OX-c86pjLfcA9uUZr1bpoVAsQdtDtuEwFlCnkyenvld2-soBVnL69z_CbmqjUNB4EtVT7YdeIGzKMyWqUiOu_leiCj4k Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:27:00.399751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fbf43b4e2ecb4fa387ad81a4a3a0d7ef", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fbf43b4e2ecb4fa387ad81a4a3a0d7ef"}]}] Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: fbf43b4e2ecb4fa387ad81a4a3a0d7ef Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesNegativeTest-1155379282 Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 23d64c421a554761babc5522164b7065 Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesNegativeTest-1155379282-project Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'a2b23860-7457-47c3-82b4-41c730f30c26'} Aug 24 15:27:00.404117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. (HTTP 404) (Request-ID: req-1e9fb98c-c2a4-4226-b706-f484acb8db59) Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.406205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 15:27:00.409388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 15:27:00.413000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3c80c3a7-5d5c-43c3-8ad2-7752d9c3c514 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] Returning 404 to user: Volume a2b23860-7457-47c3-82b4-41c730f30c26 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3c80c3a7-5d5c-43c3-8ad2-7752d9c3c514 tempest-VolumesNegativeTest-1155379282 tempest-VolumesNegativeTest-1155379282-project] 10.222.0.76 "GET /compute/v2.1/os-volumes/a2b23860-7457-47c3-82b4-41c730f30c26" status: 404 len: 109 microversion: 2.1 time: 0.038976 Aug 24 15:27:00.414661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 59/122] 10.222.0.76 () {58 vars in 1245 bytes} [Wed Aug 24 15:27:00 2022] GET /compute/v2.1/os-volumes/a2b23860-7457-47c3-82b4-41c730f30c26 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:27:00.432515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:00.433314 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:00.440898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:00.440898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:00.440898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:00.440898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:00.442702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:00.443095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:00.662796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:00.666707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:00.676433 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8dcaf42d-7bfb-42d8-8a92-ff5fb28dd2cb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.245938 Aug 24 15:27:00.678341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 64/123] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:00 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:01.323868 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-3bcf8db7-5850-4f4e-8301-aad52a77e553 req-38bce7a8-f917-459a-b404-d04bf0d64a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:01.325386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:01.327674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:01.360172 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:01.362732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-3bcf8db7-5850-4f4e-8301-aad52a77e553 req-38bce7a8-f917-459a-b404-d04bf0d64a2a service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:01.363808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:01.364688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:01.365998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:01.367150 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-3bcf8db7-5850-4f4e-8301-aad52a77e553 req-38bce7a8-f917-459a-b404-d04bf0d64a2a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:01.368706 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-3bcf8db7-5850-4f4e-8301-aad52a77e553 req-38bce7a8-f917-459a-b404-d04bf0d64a2a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:01.369379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:01.372819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:01.418442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-3bcf8db7-5850-4f4e-8301-aad52a77e553 req-38bce7a8-f917-459a-b404-d04bf0d64a2a service nova] Creating event network-changed:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:27:01.429988 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-3bcf8db7-5850-4f4e-8301-aad52a77e553 req-38bce7a8-f917-459a-b404-d04bf0d64a2a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115169 Aug 24 15:27:01.432941 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 65/124] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:27:01.631790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:01.641795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:01.643334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:01.649555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b05c5ee0-6544-4f86-b5fd-0883a1f1f19f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.337332 Aug 24 15:27:01.651082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 60/125] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:01 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:01.717516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:01.718723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:01.726278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:01.727326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:01.727920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:01.729511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:01.730365 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:01.730667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:01.922474 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:01.949135 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2e4e7b52-70b2-4b44-9c2e-4d50e105d3d4 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.234929 Aug 24 15:27:01.951276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 66/126] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:01 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:02.675008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:02.675677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:02.682465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:02.682941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:02.683361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:02.684593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:02.685255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:02.686082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:02.869781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:02.883476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:02.885901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:02.887650 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5a1c0308-e9bd-4c8b-b3a4-3ccf25a2f5b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.217683 Aug 24 15:27:02.889056 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 61/127] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:02 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:02.977809 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:02.978623 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:02.986542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:02.986913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:02.987339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:02.988039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:02.988489 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:02.988908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:03.575843 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:03.584569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-159d6126-2302-475e-aa87-073d9514f706 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.616622 Aug 24 15:27:03.586132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 67/128] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:02 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:03.917839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:03.918813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:03.925722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:03.949073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:03.953416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:03.956662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:03.957928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:03.959297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:03.959974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:04.342199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:04.369675 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:04.371387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:04.372565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-283aa04f-ba10-410e-9704-c3f785793d6a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.461000 Aug 24 15:27:04.373118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 62/129] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:03 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:04.610622 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:04.611831 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:04.614119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:04.641460 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:04.648764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:04.649213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:04.649973 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:04.652540 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:04.654719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:05.041993 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:05.053341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8c399c37-ef0f-459a-ac42-3c4e3afa6374 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.447325 Aug 24 15:27:05.063287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 68/130] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:04 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:05.398109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:05.399388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:05.406524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:05.407384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:05.407892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:05.408662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:05.409203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:05.409802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:05.652505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:05.665903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:05.667934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:05.680444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-14ab228c-e052-4719-a61c-cd5f0baaf370 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.287509 Aug 24 15:27:05.682756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 63/131] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:05 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:06.082545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:06.082545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:06.096245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:06.097044 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:06.097728 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:06.099228 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:06.100190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:06.101151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:06.398901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:06.409034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7e7a21cf-2538-4566-8a55-d407cf02b3db tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.336785 Aug 24 15:27:06.422998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 69/132] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:06 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:06.705601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:06.706786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:06.713988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:06.715011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:06.715694 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:06.716691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:06.717336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:06.718540 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:06.935825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:06.959381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:06.961660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:06.963339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5c56e89e-809e-4a00-8337-8e99df0cef01 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.261572 Aug 24 15:27:06.978256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 64/133] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:06 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:07.445464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:07.446096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:07.452896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:07.453688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:07.454390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:07.455458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:07.456296 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:07.456926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:07.627739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:07.637006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-df1c831b-7e7d-46c6-b724-c600038cc580 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.195998 Aug 24 15:27:07.638025 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 70/134] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:07 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:07.992847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:07.993476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:08.012893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:08.014366 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:08.016294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:08.018968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:08.022776 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:08.025292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:08.661342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:08.663283 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:08.670061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:08.671505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:08.671945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:08.673948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:08.674440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:08.677268 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:08.840926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:08.853873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:08.855410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:08.856881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6761684e-8bb4-49b6-888b-a6290a717c8e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.872051 Aug 24 15:27:08.860618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 65/135] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:07 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:08.868983 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:08.879979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a2c76f0e-c4bb-4192-a0f3-0cbff5195ceb tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.222993 Aug 24 15:27:08.881192 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 71/136] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:08 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:09.879323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:09.879936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:09.886879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:09.887360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:09.887967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:09.888660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:09.889768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:09.890607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:09.903624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:09.904779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:09.908514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:09.912966 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:09.913621 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:09.914049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:09.914771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:09.915392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:09.915958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:10.033646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:10.043045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:10.045122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:10.047071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1c88f4f9-2d58-4df9-b05f-5e53f1b2a489 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.171688 Aug 24 15:27:10.047768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 66/137] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:09 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:10.083520 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:10.092294 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0f444210-da9b-44ea-a2bd-6c63bf334a5b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.192239 Aug 24 15:27:10.107335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 72/138] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:09 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:11.070273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:11.070942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:11.078673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:11.079516 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:11.080128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:11.081020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:11.081843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:11.082471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:11.125096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:11.125732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:11.141204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:11.141706 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:11.142354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:11.143869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:11.144343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:11.144771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:11.278159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:11.293593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:11.296207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:11.297485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-30ee5141-f3d9-4ba1-8af8-3d76e8721f11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.231026 Aug 24 15:27:11.302698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 67/139] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:11 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:11.345277 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:11.353254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4a055743-c379-4542-a611-4c000529c007 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.235255 Aug 24 15:27:11.354363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 73/140] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:11 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:12.319665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:12.320868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:12.327664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:12.328077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:12.328658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:12.329340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:12.329785 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:12.330199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:12.377668 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:12.378543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:12.389735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:12.390569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:12.391106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:12.392327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:12.392957 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:12.393588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:12.522866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:12.547022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:12.548549 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:12.549680 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6832132c-7383-48b6-8efb-ba886344c2b8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.234340 Aug 24 15:27:12.559752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 68/141] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:12 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:12.606647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:12.615889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e88adfb9-32dc-4564-9320-e11c2aed8603 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.244823 Aug 24 15:27:12.616329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 74/142] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:12 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:13.584384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:13.585154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:13.595166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:13.596683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:13.597361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:13.598191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:13.599172 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:13.602478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:13.637240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:13.637867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:13.645646 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:13.646137 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:13.646608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:13.653644 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:13.654261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:13.654696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:13.870786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:13.896711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:13.900957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:13.902726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-caa42217-e0cc-4bb1-b193-c10f7ea4606d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.322430 Aug 24 15:27:13.904559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 69/143] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:13 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:13.941997 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:13.961339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e817dbbd-df50-48f8-b6b6-2a7c4b5a0542 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.326296 Aug 24 15:27:13.962143 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 75/144] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:13 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:14.932271 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:14.934678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:14.948435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:14.949181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:14.950605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:14.953110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:14.953982 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:14.954664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:14.982643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:14.983964 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:14.992978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:14.995305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:14.996304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:15.001746 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:15.002468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:15.003058 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:15.203900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:15.213363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cdd9c9b9-abc7-42e1-ae46-3bc388fce976 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.234462 Aug 24 15:27:15.214855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 76/145] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:14 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:15.232219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:15.243331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:15.245262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:15.246512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8aef7ffe-6e80-474e-a6ac-f22f3281f06c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.321956 Aug 24 15:27:15.247584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 70/146] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:14 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:16.236155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:16.238027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:16.244762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:16.245248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:16.245676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:16.246613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:16.247062 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:16.247659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:16.271413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:16.272006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:16.278011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:16.278743 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:16.279341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:16.280228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:16.280822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:16.281393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:16.455076 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:16.464439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8b0f7111-b561-45cb-9cd3-abacac368887 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.232796 Aug 24 15:27:16.468628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 77/147] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:16 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:16.502427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:16.512776 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:16.514914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:16.516037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-da6ee4dd-ab09-4245-a8ca-c32c9beb5d57 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.248518 Aug 24 15:27:16.516694 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 71/148] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:16 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:27:17.499205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:17.500451 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:17.508183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:17.508677 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:17.509107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:17.509809 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:17.510453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:17.510711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:17.539449 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:17.540058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:17.554008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:17.554754 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:17.555410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:17.556624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:17.557227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:17.558742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:17.610953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:17.715651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:17.734047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e4155dcd-7d99-414f-9af0-fc684a073d19 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.246564 Aug 24 15:27:17.751099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 78/149] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:17 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:17.816599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:17.827182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:17.830252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:17.831772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b00c50ea-61e4-4b6a-aa2b-a34e561010b2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.296123 Aug 24 15:27:17.832501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 72/150] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:17 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:18.760783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:18.761523 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:18.767806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:18.768292 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:18.768714 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:18.769401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:18.769852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:18.770348 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:18.858074 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:18.859262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:18.866500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:18.867271 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:18.868397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:18.870075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:18.870749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:18.871647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:18.912764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:18.921319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-82742672-3740-4e22-a358-cde9ebdb130f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.164382 Aug 24 15:27:18.921882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 79/151] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:18 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:19.045809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:19.054054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:19.055632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:19.056732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-49d5a9c6-a2ef-451e-b3d5-6cf9f2a5c206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.204081 Aug 24 15:27:19.058819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 73/152] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:18 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:19.943045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:19.944421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:19.955305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:19.955789 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:19.956337 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:19.956915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:19.957357 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:19.958123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:20.080690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:20.084542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:20.091066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:20.091902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:20.092560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:20.093472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:20.094542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:20.095171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:20.102723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:20.112026 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-590d4f63-de74-4385-b5f1-96c6cdd42119 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.174574 Aug 24 15:27:20.113583 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 80/153] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:19 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:20.253113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:20.261790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:20.263327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:20.264966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3c939a88-f56a-49bf-8e01-7daa459df9c6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.188950 Aug 24 15:27:20.265514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 74/154] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:20 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:21.136146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:21.136763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:21.144969 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:21.145690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:21.146335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:21.147229 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:21.148658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:21.150032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:21.170380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-a1683157-2d45-4caf-89f5-d77654e68a44 req-a935f0e4-0b25-4808-8259-6fdd2e82f684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12", "name": "network-vif-plugged", "status": "completed", "tag": "b16b906a-9ef3-40ca-931e-d8ef832c7482"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:21.187204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-a1683157-2d45-4caf-89f5-d77654e68a44 req-a935f0e4-0b25-4808-8259-6fdd2e82f684 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:21.187764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-a1683157-2d45-4caf-89f5-d77654e68a44 req-a935f0e4-0b25-4808-8259-6fdd2e82f684 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:21.188691 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-a1683157-2d45-4caf-89f5-d77654e68a44 req-a935f0e4-0b25-4808-8259-6fdd2e82f684 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:21.205547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-a1683157-2d45-4caf-89f5-d77654e68a44 req-a935f0e4-0b25-4808-8259-6fdd2e82f684 service nova] Creating event network-vif-plugged:b16b906a-9ef3-40ca-931e-d8ef832c7482 for instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 on hv-cinder-84890 Aug 24 15:27:21.213909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-a1683157-2d45-4caf-89f5-d77654e68a44 req-a935f0e4-0b25-4808-8259-6fdd2e82f684 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112468 Aug 24 15:27:21.214896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 81/155] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:27:21.286885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:21.288569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:21.289273 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:21.295537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-76f786ec-fb5a-46ec-9f8e-17ef0c4f50e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.163348 Aug 24 15:27:21.296283 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 75/156] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:21 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:21.296984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:21.297675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:21.298114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:21.298845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:21.299364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:21.299806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:21.485231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:21.488884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:21.494535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:21.496073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:21.497222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-56df9ba5-0ab0-4f82-89b6-769694c21a55 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.213091 Aug 24 15:27:21.498038 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 82/157] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:21 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:27:22.318978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:22.320295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:22.327099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:22.327899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:22.328514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:22.329596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:22.330340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:22.330867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:22.484851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:22.493206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6749a11a-6d83-41ee-b6df-70318a963c35 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.179592 Aug 24 15:27:22.494121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 76/158] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:22 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:22.521118 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:22.521791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:22.527819 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:22.528611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:22.529227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:22.530539 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:22.531409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:22.532236 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:22.694983 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:22.703658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:22.705159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:22.706312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0580c36d-5521-48e7-aafb-61a5f8475975 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.189492 Aug 24 15:27:22.706877 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 83/159] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:22 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:27:23.526354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:23.527007 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:23.533436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:23.534021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:23.534398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:23.535091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:23.535544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:23.535985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:23.684437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:23.693869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c589a6b0-c6ab-43ba-b2c7-f8c11acc505b tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.170478 Aug 24 15:27:23.693869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 77/160] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:23 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:23.729129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:23.729962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:23.736738 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:23.737327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:23.737841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:23.738651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:23.739183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:23.739605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:23.887226 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:23.896253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:23.897750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:23.899107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6a1dee45-c661-4ba3-af9c-5cc1198baaac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.173948 Aug 24 15:27:23.899650 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 84/161] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:23 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:27:24.714416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:24.715106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:24.721750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:24.722259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:24.722695 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:24.723388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:24.723837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:24.724259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:24.855241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:24.863099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2e106f7e-bf72-4554-9e07-6838406456ef tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.152484 Aug 24 15:27:24.863668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 78/162] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:24 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:24.935060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:24.936187 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:24.943001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:24.943672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:24.944317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:24.945769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:24.946451 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:24.947189 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:25.141694 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:25.150696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:25.152318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:25.153509 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6b19ac8e-8115-440a-ac1d-bc5b1fbbb3cb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.222980 Aug 24 15:27:25.154156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 85/163] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:24 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:25.884648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:25.885257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:25.891200 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:25.891725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:25.892158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:25.892841 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:25.893291 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:25.893711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:26.019818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:26.027495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0c57a55f-4fec-4bb0-9d46-f5b9d0e70fc6 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.147058 Aug 24 15:27:26.028058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 79/164] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:25 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:26.176709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:26.177318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:26.183397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:26.183877 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:26.184309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:26.184997 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:26.185464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:26.185985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:26.386581 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:26.397666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:26.399688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:26.401406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-42d29b79-f687-433c-bcb8-339a38235eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.228405 Aug 24 15:27:26.402710 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 86/165] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:26 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:26.726336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "name": "network-vif-plugged", "status": "completed", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:26.739285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:26.739998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:26.740609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:26.762623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Creating event network-vif-plugged:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:27:26.763323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 15:27:26.764517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-b9667587-a308-47c9-94a7-83a5540a558a req-824d5956-c065-41c3-803d-20b09a4f8dd8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 15:27:26.765713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:26.766356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:26.766953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:26.767825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:26.768269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:26.768850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:26.779304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.compute.rpcapi [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 15:27:26.781146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] Releasing lock "compute-rpcapi-router" {{(pid=120849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 15:27:26.804714 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0851e1ba-1414-4f3f-9aac-ba2809177dfa None None] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082002 Aug 24 15:27:26.806003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 80/166] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:27:27.049381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:27.050330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:27.057082 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:27.057804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:27.058481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:27.059290 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:27.059860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:27.060362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:27.211688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:27.219575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-adc5fe3e-76db-4d0a-b753-c6a303070347 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1315 microversion: 2.1 time: 0.174655 Aug 24 15:27:27.220140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 87/167] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:27 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:27.430313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:27.430313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:27.436531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:27.437208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:27.437641 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:27.438379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:27.438832 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:27.439260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:27.576665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:27.585478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:27.589397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:27.589397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2810f282-b3d7-45ae-bb8d-740236bc3c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.164633 Aug 24 15:27:27.589397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 81/168] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:27 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:28.246177 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:28.248308 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:28.260823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:28.261782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:28.262657 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:28.264513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:28.265414 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:28.266261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:28.407512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:28.415239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-46b4a303-cdab-43d3-a7c1-83ecc7685b4e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1501 microversion: 2.1 time: 0.176955 Aug 24 15:27:28.415802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 88/169] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:28 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:28.611685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:28.612253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:28.618275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:28.618751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:28.619178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:28.619859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:28.620304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:28.620722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:28.772997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:28.782210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:28.783963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:28.785135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e5767467-4f04-43f2-9987-4eac9de3a4b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.177712 Aug 24 15:27:28.785799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 82/170] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:28 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:29.808155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:29.808762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:29.815382 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:29.815860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:29.816333 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:29.817019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:29.817470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:29.817889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:29.947559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:29.956304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:29.957811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:29.959303 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dba3ba5d-651e-41ae-ad81-6b960b896778 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.154787 Aug 24 15:27:29.959511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 89/171] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:29 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:30.981542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:30.982170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:30.988212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:30.988685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:30.989105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:30.989783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:30.990237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:30.990660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:31.124062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:31.132141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:31.133617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:31.134765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-dc173a57-6a55-413e-ae12-b6d3f3bc6098 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.157090 Aug 24 15:27:31.135310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 83/172] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:30 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:32.157505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:32.158125 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:32.164142 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:32.164623 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:32.165057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:32.165745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:32.166198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:32.166643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:32.299069 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:32.307553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:32.309037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:32.310129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6d21ca6f-21f0-43b5-9889-81740fca612f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.157149 Aug 24 15:27:32.310731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 90/173] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:32 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:33.333444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:33.334043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:33.340717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:33.341275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:33.341815 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:33.342526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:33.343047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:33.343519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:33.503256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:33.519264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:33.520928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:33.522048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9f637b2a-4c83-4938-bea9-a7c2d4671ec8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1408 microversion: 2.20 time: 0.193051 Aug 24 15:27:33.526287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 84/174] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:33 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:34.548439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:34.550106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:34.558244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:34.559222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:34.559818 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:34.561524 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:34.562119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:34.562702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:34.758456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:34.768367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:34.770005 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:34.771400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-325273c6-eee4-40cc-881f-bdd2a42e7c29 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1601 microversion: 2.20 time: 0.228882 Aug 24 15:27:34.772414 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 91/175] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:27:34 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1601 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:27:34.800109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:34.800978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:34.811130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=46 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:34.814353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:34.815076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:34.815953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:34.817027 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:34.817657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:34.818350 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:34.991932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4e0050a4-0d8f-40bc-991f-43643fef2b46 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200070 Aug 24 15:27:34.992708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 85/176] 10.222.0.76 () {60 vars in 1316 bytes} [Wed Aug 24 15:27:34 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-interface => generated 285 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:27:35.164013 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a5aef4d-91a4-48c2-bce5-7c6b8284d738"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:35.168302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:35.175353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=48 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:35.178258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:35.178823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:35.179333 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:35.180135 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:35.180821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:35.181322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:35.865061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2a1e8b59-65fe-4201-b5ff-48a92506189f tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "POST /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707296 Aug 24 15:27:35.866128 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 92/177] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:27:35 2022] POST /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:27:37.229404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-96515479-2856-46dc-9b54-65a1fda9e9f3 req-cecb2266-517c-4ad8-8894-e2bb38e9bdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:37.273680 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:37.290517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-96515479-2856-46dc-9b54-65a1fda9e9f3 req-cecb2266-517c-4ad8-8894-e2bb38e9bdaa service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:37.291006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-96515479-2856-46dc-9b54-65a1fda9e9f3 req-cecb2266-517c-4ad8-8894-e2bb38e9bdaa service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:37.291437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-96515479-2856-46dc-9b54-65a1fda9e9f3 req-cecb2266-517c-4ad8-8894-e2bb38e9bdaa service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:37.325753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-96515479-2856-46dc-9b54-65a1fda9e9f3 req-cecb2266-517c-4ad8-8894-e2bb38e9bdaa service nova] Creating event network-changed:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:27:37.333599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-96515479-2856-46dc-9b54-65a1fda9e9f3 req-cecb2266-517c-4ad8-8894-e2bb38e9bdaa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116398 Aug 24 15:27:37.334444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 86/178] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:27:44.184349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1628749064", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:44.313715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] validate_networks() for None {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:27:44.799179 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:27:44.800264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:27:44.801279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:27:44.801747 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:27:44.802193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:27:44.814835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:44.815673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:44.816615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:44.817935 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:44.818840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:44.819336 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:44.852834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Getting quotas for project f63eb112769442ddbbe718fd4169cac7. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:27:44.857967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Getting quotas for user 23c2101de3874d9ab296aa1e6b5e9b2c and project f63eb112769442ddbbe718fd4169cac7. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:27:44.876710 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:27:44.879529 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:27:44.968224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a91d364f-c23d-4e0c-9036-9a57cafa859b tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787985 Aug 24 15:27:44.969944 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 93/179] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:27:44.983516 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c142fac8-5b9c-4958-a9c6-78db3a428535 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:44.984398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c142fac8-5b9c-4958-a9c6-78db3a428535 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:45.082038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c142fac8-5b9c-4958-a9c6-78db3a428535 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:45.099909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c142fac8-5b9c-4958-a9c6-78db3a428535 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1215 microversion: 2.1 time: 0.118826 Aug 24 15:27:45.107366 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 87/180] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:44 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:45.157035 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:45.157793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:45.168982 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:45.170030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:45.170490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:45.171205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:45.171653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:45.172072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:45.233197 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:27:45.505479 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fdade022-7de2-4606-8954-af1eea2571c5 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 204 len: 0 microversion: 2.1 time: 0.352058 Aug 24 15:27:45.507699 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 94/181] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:27:45 2022] DELETE /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:27:45.520171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:45.522039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:45.539239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:45.540426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:45.543826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:45.551695 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:45.555141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:45.556618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:45.851960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:45.862277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3cb59edb-9451-4af7-8073-0e8f2545df83 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1553 microversion: 2.1 time: 0.348799 Aug 24 15:27:45.863049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 88/182] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:45 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:46.125628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:46.127062 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:46.140425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:46.141338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:46.142264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:46.143298 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:46.144742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:46.145270 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:46.232278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:46.243805 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-57ed5426-cd96-46eb-9761-890f82fdbacb tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1219 microversion: 2.1 time: 0.125292 Aug 24 15:27:46.244833 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 95/183] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:46 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:46.614844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1512833077", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "networks": [{"uuid": "34be3f10-b199-452c-9836-0433866560c3"}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:46.685007 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] validate_networks() for [('34be3f10-b199-452c-9836-0433866560c3', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:27:46.890138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:46.890843 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:46.905624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:46.908055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:46.911495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:46.912580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:46.913575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:46.916076 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:47.293289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:47.320093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:27:47.321473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:27:47.323061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:27:47.323676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:27:47.324355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:27:47.326876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6fe09a61-5797-4e08-9dda-452838df23f8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1553 microversion: 2.1 time: 0.440606 Aug 24 15:27:47.328318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 96/184] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:46 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:47.346893 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:47.347802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:47.354182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:47.355951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:47.356682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:47.357511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:47.357722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:47.358437 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:47.358873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:47.359330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:47.359755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:47.360250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:47.360920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:47.361551 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:47.366522 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:47.385792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Getting quotas for project 00071111c84346639e5245e5c173dad5. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:27:47.390470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Getting quotas for user 22c5f040350d4daba0ebe2af86849a23 and project 00071111c84346639e5245e5c173dad5. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:27:47.405893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:27:47.408592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:27:47.461219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ec31650b-b456-4990-90d7-9867058d490e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851535 Aug 24 15:27:47.468943 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 89/185] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:27:47.474345 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7b49f0d2-f995-4c58-95d8-a18435c0f9b2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:47.475992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7b49f0d2-f995-4c58-95d8-a18435c0f9b2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:47.520486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:47.540335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-23d97462-a58f-47b0-9d8e-f04b22fe8eae tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1267 microversion: 2.1 time: 0.207708 Aug 24 15:27:47.541556 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 97/186] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:47 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:47.620222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7b49f0d2-f995-4c58-95d8-a18435c0f9b2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:47.633162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7b49f0d2-f995-4c58-95d8-a18435c0f9b2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1219 microversion: 2.1 time: 0.159799 Aug 24 15:27:47.646576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 90/187] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:47 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:48.350155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:48.351496 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:48.361520 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:48.362160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:48.362950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:48.363658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:48.364588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:48.365088 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:48.562998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:48.563718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:48.573813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:48.576383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:48.577095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:48.583064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:48.584454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:48.585818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:48.598422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=87 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:48.629835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:48.638485 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-02b70068-3626-4430-8c1b-39d1c9eefc0c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1553 microversion: 2.1 time: 0.292349 Aug 24 15:27:48.639084 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 98/188] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:48 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1553 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:48.659964 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:48.660555 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:48.671560 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:48.671970 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:48.672397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:48.673235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:48.674201 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:48.674507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:48.697996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:48.708750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-feab2bfa-040f-4f7e-a845-35531223c472 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1275 microversion: 2.1 time: 0.150295 Aug 24 15:27:48.714188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 91/189] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:48 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:48.776640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:48.795945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3d618c64-cbba-4cd4-ad2f-16fc579d7e7a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1223 microversion: 2.1 time: 0.139952 Aug 24 15:27:48.797442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 99/190] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:48 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:49.660265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:49.660791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:49.667339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:49.668360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:49.668983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:49.670581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:49.671274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:49.672071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:49.731943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:49.732638 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:49.739061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:49.739654 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:49.740118 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:49.740834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:49.741337 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:49.741772 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:49.820798 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:49.832048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ca758a0f-ba28-4718-859f-be6807b480dd tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1275 microversion: 2.1 time: 0.104876 Aug 24 15:27:49.833578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 100/191] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:49 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:49.840352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:49.842480 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:49.853528 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:49.854476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:49.855195 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:49.856328 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:49.857010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:49.857633 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:49.900618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:49.915497 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e624693f-c498-4194-8674-71201245cfe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1553 microversion: 2.1 time: 0.259824 Aug 24 15:27:49.916616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 92/192] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:49 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:49.965566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:49.981181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f3670573-8b9d-410e-b8c0-d436d4d19488 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1223 microversion: 2.1 time: 0.145196 Aug 24 15:27:49.982381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 101/193] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:49 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:50.856240 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:50.857458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:50.863969 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:50.864481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:50.864912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:50.865596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:50.866042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:50.866486 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:50.938549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:50.941861 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:50.952971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:50.954367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:50.956608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:50.957104 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:50.957890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:50.958395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:50.958825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:50.976821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1e3ef05d-10d9-48f0-9332-89ad211081d6 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1275 microversion: 2.1 time: 0.125127 Aug 24 15:27:50.977401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 93/194] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:50 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:51.006720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:51.007340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:51.019839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:51.020357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:51.020810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:51.024718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:51.025205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:51.025639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:51.113951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:51.124613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c8e10d5f-5cc6-4f9f-909c-d3bf22114627 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1223 microversion: 2.1 time: 0.123750 Aug 24 15:27:51.125347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 94/195] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:50 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:51.170412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:51.180882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4cf35a7e-afee-40b6-9840-09d61640218a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1553 microversion: 2.1 time: 0.246692 Aug 24 15:27:51.181856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 102/196] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:50 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:51.997153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:51.997877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:52.006477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:52.007063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:52.007596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:52.008644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:52.009101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:52.009525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:52.077337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:52.085330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a90790d1-467f-45f9-aaf4-3f09bafe7b5a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1275 microversion: 2.1 time: 0.092099 Aug 24 15:27:52.085953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 95/197] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:51 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:52.145396 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:52.146011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:52.152129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:52.152606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:52.153037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:52.154405 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:52.154860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:52.155276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:52.203936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:52.204680 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:52.210673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:52.211164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:52.211575 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:52.212260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:52.212706 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:52.213124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:52.224260 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:52.235430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f8819681-0678-454a-95c7-7b840b1c2c6a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1223 microversion: 2.1 time: 0.093830 Aug 24 15:27:52.236203 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 103/198] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:52 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:52.465601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:52.477611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fcea20cd-7c1b-401a-8cb7-9cf8e051dc64 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1553 microversion: 2.1 time: 0.278560 Aug 24 15:27:52.492000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 96/199] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:52 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1553 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:53.112376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:53.113404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:53.123673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.124642 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.125245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.127408 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.128497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.129464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.213145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:53.226818 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3bc7524d-8562-4f9e-bf66-0aaa68e8be73 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.123829 Aug 24 15:27:53.227624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 104/200] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:53 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:53.257960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:53.258825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:53.272054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.275079 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.275770 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.276804 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.277681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.278481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.416488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-531ccef6-079f-4eca-88e0-a682af7eae39 req-7d1cf9c4-54cf-4eed-9c3f-427029e753a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12", "name": "network-vif-deleted", "tag": "b16b906a-9ef3-40ca-931e-d8ef832c7482"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:27:53.421168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:53.429577 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-89e79abe-da53-4a70-a04a-3a186cce83f7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1271 microversion: 2.1 time: 0.175921 Aug 24 15:27:53.430170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 97/201] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:53 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:53.430542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-531ccef6-079f-4eca-88e0-a682af7eae39 req-7d1cf9c4-54cf-4eed-9c3f-427029e753a3 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.431124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-531ccef6-079f-4eca-88e0-a682af7eae39 req-7d1cf9c4-54cf-4eed-9c3f-427029e753a3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.431834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-531ccef6-079f-4eca-88e0-a682af7eae39 req-7d1cf9c4-54cf-4eed-9c3f-427029e753a3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.455677 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-531ccef6-079f-4eca-88e0-a682af7eae39 req-7d1cf9c4-54cf-4eed-9c3f-427029e753a3 service nova] Creating event network-vif-deleted:b16b906a-9ef3-40ca-931e-d8ef832c7482 for instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 on hv-cinder-84890 Aug 24 15:27:53.462581 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-531ccef6-079f-4eca-88e0-a682af7eae39 req-7d1cf9c4-54cf-4eed-9c3f-427029e753a3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051566 Aug 24 15:27:53.463799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 105/202] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:27:53.514031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:53.514672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:53.520900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.521645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.522296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.523044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:53.523616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:53.524150 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:53.603806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:53.623987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4fa50671-bb82-4e44-8821-fc3cd61fbc66 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1511 microversion: 2.1 time: 0.105621 Aug 24 15:27:53.623987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 98/203] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:53 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1511 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:54.252310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:54.253098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:54.259967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:54.260478 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:54.260908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:54.261601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:54.262056 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:54.262505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:54.338723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:54.347851 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bfc0727a-4a58-4548-afaf-e746bbf82032 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.100772 Aug 24 15:27:54.349104 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 106/204] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:54 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:54.453122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:54.453747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:54.460328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:54.460984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:54.461420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:54.462125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:54.462692 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:54.463119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:54.547328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:54.556286 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-916f0c19-91da-4093-b322-13cc3b4e3500 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1271 microversion: 2.1 time: 0.107355 Aug 24 15:27:54.557630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 99/205] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:54 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:54.648941 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:54.650274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:54.662574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:54.663816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:54.664780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:54.666768 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:54.668655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:54.670141 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:54.777685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:54.787696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d3f93c10-253c-4f73-925b-de687a05b650 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1511 microversion: 2.1 time: 0.152362 Aug 24 15:27:54.791590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 107/206] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:54 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:55.369103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:55.369923 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:55.389468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:55.390153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:55.390652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:55.391806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:55.392614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:55.393317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:55.471112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:55.480677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a93222ea-c03e-4413-a35b-1941918943ed tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.115252 Aug 24 15:27:55.481676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 100/207] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:55 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:55.578779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:55.579499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:55.581689 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:55.582936 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:55.595800 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:55.596422 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:55.597235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:55.598064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:55.598536 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:55.599199 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:55.706238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:55.720664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f894ae69-94ff-4a25-9642-c9e56d414c34 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1271 microversion: 2.1 time: 0.146499 Aug 24 15:27:55.722382 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 108/208] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:55 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:27:55.819925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:55.820596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:55.828378 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:55.829069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:55.829648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:55.831057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:55.831609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:55.832029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:55.913664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:55.924032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ecb103b0-9f24-4156-b53a-8e306ec79a4c tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1511 microversion: 2.1 time: 0.109053 Aug 24 15:27:55.924244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 101/209] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:55 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1511 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:56.502202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:56.503002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:56.509183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:56.509748 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:56.510396 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:56.511176 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:56.511773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:56.512266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:56.605977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:56.616832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bb446a29-f2ce-4b8d-b669-6a51711cb5a4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.118702 Aug 24 15:27:56.617855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 109/210] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:56 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:56.743993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:56.746463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:56.761332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:56.761834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:56.762302 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:56.763682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:56.764355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:56.764917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:56.846676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:56.854620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e2133bc8-9d2d-4e81-8d51-5521b858ee44 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1271 microversion: 2.1 time: 0.116153 Aug 24 15:27:56.855195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 102/211] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:56 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:56.946246 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:56.946953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:56.957064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:56.958841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:56.959492 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:56.960332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:56.960886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:56.961436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:57.052512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:57.061712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d0997147-d381-40da-b2be-a5440244e0fd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1511 microversion: 2.1 time: 0.120113 Aug 24 15:27:57.062605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 110/212] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:56 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1511 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:57.642238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:57.642954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:57.644925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:57.645664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=10 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:27:57.651975 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:57.652490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:57.652931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:57.654183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:57.654670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:57.655089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:57.730919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:57.739287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-35190592-480e-4b4c-9fa8-0a9b2a3c6df4 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.100929 Aug 24 15:27:57.739870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 103/213] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:57 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:57.880431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:57.881379 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:57.887922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:57.888399 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:57.888824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:57.889527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:57.889972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:57.890425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:57.964679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:57.973526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5d4b72fd-8c2a-4bb2-825b-f533b7ac70ee tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1271 microversion: 2.1 time: 0.097125 Aug 24 15:27:57.974210 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 111/214] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:57 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:58.095458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:58.096536 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:58.107964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:58.109281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:58.109281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:58.110353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:58.110353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:58.110353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:58.203450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:58.213242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6aefe871-4f0c-4070-998d-861480ce8fe1 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1511 microversion: 2.1 time: 0.126202 Aug 24 15:27:58.214112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 104/215] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:58 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1511 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:58.761815 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:58.762456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:58.768875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:58.769349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:58.769778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:58.770634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:58.770953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:58.771397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:58.850474 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:58.862853 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bf143c5b-291f-4345-ba83-60e5bfc4ae77 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.105856 Aug 24 15:27:58.869555 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 112/216] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:58 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:59.005843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:59.007200 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:59.016091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:59.016646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:59.017078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:59.017952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:59.018607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:59.019177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:59.113706 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:59.124880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5eafc50b-396d-4371-a40c-d1bf0a22b638 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1271 microversion: 2.1 time: 0.128067 Aug 24 15:27:59.125612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 105/217] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:58 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:59.235345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:59.235956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:59.242799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:59.243283 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:59.243715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:59.244418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:59.244877 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:59.245295 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:59.352587 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:27:59.364494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e22625a5-2e22-462f-8a89-1994f80a83d8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1346 microversion: 2.1 time: 0.132468 Aug 24 15:27:59.365871 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 113/218] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:59 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:27:59.885744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:27:59.886640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:27:59.904267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:59.904267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:59.904267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:27:59.904267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:27:59.904753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:27:59.904753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:00.060231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:00.069772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-80ded220-9a56-434f-9f8a-719a5d5145be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1273 microversion: 2.1 time: 0.188924 Aug 24 15:28:00.070728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 106/219] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:27:59 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:00.147363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:00.148045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:00.155490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:00.156268 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:00.156702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:00.157663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:00.158434 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:00.158857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:00.206691 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:00.314064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:00.331608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a88daee9-7e3f-42cd-af8d-8181e2d1fc4a tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1277 microversion: 2.1 time: 0.187560 Aug 24 15:28:00.332583 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 114/220] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:00 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:00.393807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:00.394465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:00.400734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:00.401634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:00.402413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:00.403425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:00.403976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:00.405219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:00.492790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:00.495663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:00.513980 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-77de913c-29c3-412d-af5b-c77dbfc5877e tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1346 microversion: 2.1 time: 0.123977 Aug 24 15:28:00.515123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 107/221] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:00 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:01.104488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:01.105397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:01.129432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.133288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.136463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.152518 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.154107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.155102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.368499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:01.369107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:01.384406 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.385885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.386657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.387725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.388522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.389156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.542256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:01.550664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4d42b5b6-6a40-4d99-8a9d-86dc5f002ca6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1277 microversion: 2.1 time: 0.185972 Aug 24 15:28:01.553099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 108/222] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:01 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:01.577687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:01.578820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:01.604298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.605056 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.605872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.606836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.609209 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.609876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.653855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:01.654495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:01.655099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:01.655571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lazy-loading 'fault' on Instance uuid d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:28:01.717896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:01.742160 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7a4e434c3c74b239c50da6b5d500c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3f4fde69fc4507837f9feb27ceed01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:01.754455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-68390123-86a7-468b-a56b-e7d3f889877e tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.651635 Aug 24 15:28:01.757346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 115/223] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:01 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:01.770067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-18d2b998-fe09-4c24-b5c2-224f42c376cd tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 200 len: 1351 microversion: 2.1 time: 0.202425 Aug 24 15:28:01.770702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 109/224] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:01 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:02.586354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:02.587532 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:02.597979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:02.599264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:02.600326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:02.601345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:02.602191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:02.603449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:02.782806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:02.784206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:02.811365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:02.812263 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:02.813488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:02.814813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:02.815484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:02.816068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:03.067853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:03.086419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ba0281ce-1335-4f65-9df6-c23dbf734ae0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.304470 Aug 24 15:28:03.087404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 110/225] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:02 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:03.099956 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:03.100789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:03.108874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:03.109484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:03.109968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:03.110790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:03.116885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:03.117686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:03.136594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] HTTP exception thrown: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Request method failure captured: Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 HTTP/1.1 Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMqn7U_9KxcYygC0D8qMs01smB9QfQLGhDfIzDezkjnWofyCn1kEG4nQ-sPQI7VkF_yLi8FTm_1X_N8-C7wthq7A3TElmikocub-sukayZl2yHniPUMKjqGsfWgg6ePdJZpHx5bqDktwuVmfkC9rVfRyGepSNY30xAQSKvC1WMLTWU Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:28:03.147784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fd3f4fde69fc4507837f9feb27ceed01", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}] Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: b7a4e434c3c74b239c50da6b5d500c23 Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.149875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'd0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12'} Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:28:03.151201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.154313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.156430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Returning 404 to user: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:28:03.156430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3d4a585d-0ae2-4da8-8928-c561d29169e8 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 404 len: 111 microversion: 2.1 time: 0.061203 Aug 24 15:28:03.156430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 111/226] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:03 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:28:03.161591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-f7493d2f-7b76-4178-8259-22298b156b3a req-33240055-bfcd-496f-8339-3ee6f3df4358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11131c4b-e6e3-433c-868c-5174ff220680", "tag": "bd06d91b-2dd3-4a8f-b3bd-f2e1c896db08"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:03.195205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-f7493d2f-7b76-4178-8259-22298b156b3a req-33240055-bfcd-496f-8339-3ee6f3df4358 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:03.196066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-f7493d2f-7b76-4178-8259-22298b156b3a req-33240055-bfcd-496f-8339-3ee6f3df4358 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:03.197621 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-f7493d2f-7b76-4178-8259-22298b156b3a req-33240055-bfcd-496f-8339-3ee6f3df4358 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:03.249346 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-f7493d2f-7b76-4178-8259-22298b156b3a req-33240055-bfcd-496f-8339-3ee6f3df4358 service nova] Creating event network-changed:bd06d91b-2dd3-4a8f-b3bd-f2e1c896db08 for instance 11131c4b-e6e3-433c-868c-5174ff220680 on hv-cinder-84890 Aug 24 15:28:03.267948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-f7493d2f-7b76-4178-8259-22298b156b3a req-33240055-bfcd-496f-8339-3ee6f3df4358 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110575 Aug 24 15:28:03.269164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 112/227] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:03.368580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:03.388599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6fd1758e-d04c-4dfc-b01c-e491688b9ac9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.811616 Aug 24 15:28:03.390288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 116/228] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:02 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:03.474145 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:03.479436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:03.511016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:03.512262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:03.513718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:03.516112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:03.517128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:03.518154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:03.567159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] HTTP exception thrown: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Request method failure captured: Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12/os-volume_attachments HTTP/1.1 Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMqn7U_9KxcYygC0D8qMs01smB9QfQLGhDfIzDezkjnWofyCn1kEG4nQ-sPQI7VkF_yLi8FTm_1X_N8-C7wthq7A3TElmikocub-sukayZl2yHniPUMKjqGsfWgg6ePdJZpHx5bqDktwuVmfkC9rVfRyGepSNY30xAQSKvC1WMLTWU Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:28:03.570106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fd3f4fde69fc4507837f9feb27ceed01", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}] Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: b7a4e434c3c74b239c50da6b5d500c23 Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.573129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'server_id': 'd0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12'} Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:28:03.574393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:03.576709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:03.578801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Returning 404 to user: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:28:03.578801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b12e32cf-5b7a-4e6d-8e93-2f70008ccc2a tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.108141 Aug 24 15:28:03.578801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 113/229] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:28:03 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:28:04.113547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:04.114822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:04.122178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.122681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.123109 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.123830 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.124244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.124750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.329071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:04.339371 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1bc56bf0-1664-46f9-87f5-901a3f1c8f8f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.233615 Aug 24 15:28:04.339958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 117/230] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:04 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:04.430268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:04.431179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:04.439082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.439591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.440106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.441249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.441875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.443329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.672957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:04.702986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e053d598-5a88-4c18-be8f-2cb818abcaa6 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.276730 Aug 24 15:28:04.718440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 114/231] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:04 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:04.901162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:04.901777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:04.908452 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.908939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.909375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.910074 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.910564 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.910991 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.925716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] HTTP exception thrown: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Request method failure captured: Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 HTTP/1.1 Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkMqn7U_9KxcYygC0D8qMs01smB9QfQLGhDfIzDezkjnWofyCn1kEG4nQ-sPQI7VkF_yLi8FTm_1X_N8-C7wthq7A3TElmikocub-sukayZl2yHniPUMKjqGsfWgg6ePdJZpHx5bqDktwuVmfkC9rVfRyGepSNY30xAQSKvC1WMLTWU Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:28:04.930455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fd3f4fde69fc4507837f9feb27ceed01", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}] Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: b7a4e434c3c74b239c50da6b5d500c23 Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.932783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': 'd0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12'} Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:28:04.933886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.935730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.938171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Returning 404 to user: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:28:04.938171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f722dc30-d64c-4d34-9132-7513fd453805 tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 404 len: 111 microversion: 2.1 time: 0.034962 Aug 24 15:28:04.938171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 118/232] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:28:04 2022] DELETE /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:28:04.943811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:04.944749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] [instance: d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:04.946909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:04.953123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.954028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.954634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.955767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:04.956298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:04.956681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:04.973539 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] HTTP exception thrown: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Request method failure captured: Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 HTTP/1.1 Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMqn7U_9KxcYygC0D8qMs01smB9QfQLGhDfIzDezkjnWofyCn1kEG4nQ-sPQI7VkF_yLi8FTm_1X_N8-C7wthq7A3TElmikocub-sukayZl2yHniPUMKjqGsfWgg6ePdJZpHx5bqDktwuVmfkC9rVfRyGepSNY30xAQSKvC1WMLTWU Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:28:04.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_fd3f4fde69fc4507837f9feb27ceed01", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/fd3f4fde69fc4507837f9feb27ceed01"}]}] Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: fd3f4fde69fc4507837f9feb27ceed01 Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1418457443 Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: b7a4e434c3c74b239c50da6b5d500c23 Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-DeleteServersTestJSON-1418457443-project Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.977287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'd0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12'} Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:28:04.978257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. Aug 24 15:28:04.979798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:04.983673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] Returning 404 to user: Instance d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:28:04.983673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-735e478b-112d-4844-91e8-2c4dfc0004ab tempest-DeleteServersTestJSON-1418457443 tempest-DeleteServersTestJSON-1418457443-project] 10.222.0.76 "GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12" status: 404 len: 111 microversion: 2.1 time: 0.037671 Aug 24 15:28:04.983673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 115/233] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:04 2022] GET /compute/v2.1/servers/d0a4a51f-f6fa-4ba9-b03c-af1c10ae0d12 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:28:05.345799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-d68cbda8-1e38-4af7-8511-d7ceaef3555d req-ab2d362f-3eda-425d-a2af-80f03689c6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d102fd3a-a604-4ee9-a585-64564a60a2c3", "tag": "82bca62b-0802-4d60-8002-d5fe93d1d6b8"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:05.353652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:05.368082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:05.369231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:05.381982 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d68cbda8-1e38-4af7-8511-d7ceaef3555d req-ab2d362f-3eda-425d-a2af-80f03689c6d6 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:05.385830 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d68cbda8-1e38-4af7-8511-d7ceaef3555d req-ab2d362f-3eda-425d-a2af-80f03689c6d6 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:05.386782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d68cbda8-1e38-4af7-8511-d7ceaef3555d req-ab2d362f-3eda-425d-a2af-80f03689c6d6 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:05.388839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:05.391786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:05.392527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:05.394206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:05.396522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:05.397185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:05.421273 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-d68cbda8-1e38-4af7-8511-d7ceaef3555d req-ab2d362f-3eda-425d-a2af-80f03689c6d6 service nova] Creating event network-changed:82bca62b-0802-4d60-8002-d5fe93d1d6b8 for instance d102fd3a-a604-4ee9-a585-64564a60a2c3 on hv-cinder-84890 Aug 24 15:28:05.429846 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-d68cbda8-1e38-4af7-8511-d7ceaef3555d req-ab2d362f-3eda-425d-a2af-80f03689c6d6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094079 Aug 24 15:28:05.434023 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 119/234] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:05.757205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:05.759661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:05.777325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:05.781660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:05.783034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:05.791398 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:05.795379 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:05.796253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:06.006738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:06.015564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-09410736-0326-43a8-91a7-858a4cc139fe tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.652319 Aug 24 15:28:06.023610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 116/235] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:05 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:06.043789 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:06.056264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a217b3e6-7760-41b9-b83e-4e01911abec9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.319878 Aug 24 15:28:06.065803 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 120/236] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:05 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:07.048623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:07.049793 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:07.068024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:07.070767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:07.071463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:07.074180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:07.075851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:07.077412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:07.083949 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:07.085875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:07.108051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:07.109686 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:07.110739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:07.111967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:07.112975 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:07.113732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:07.910863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:07.926943 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8f2d006e-9342-4639-9207-15da1658f0c2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.885596 Aug 24 15:28:07.927531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 117/237] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:07 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:08.161525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:08.188458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dd02ca9c-d2b5-4ae4-8399-1aedf06f60df tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 1.111897 Aug 24 15:28:08.195557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 121/238] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:07 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:08.957530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:08.959492 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:08.969299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:08.970349 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:08.971262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:08.972868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:08.973617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:08.974935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:09.216699 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:09.217325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:09.227139 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:09.227885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:09.228502 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:09.229371 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:09.229978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:09.230671 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:09.235980 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:09.257188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7281268e-7aa6-4ef0-b846-ddbf6455e060 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.305960 Aug 24 15:28:09.273653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 118/239] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:08 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:09.426009 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:09.434638 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d18b6969-9df9-41c7-9523-daa688897c71 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.222066 Aug 24 15:28:09.446727 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 122/240] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:09 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:10.281591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:10.282750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:10.289408 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:10.290128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:10.290757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:10.292927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:10.293468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:10.295157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:10.456308 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:10.457028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:10.463671 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:10.464175 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:10.464610 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:10.465315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:10.466320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:10.466797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:10.537480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:10.546470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-18b1612e-5b88-4a82-bdf5-97cc6c578f91 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.269294 Aug 24 15:28:10.553224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 119/241] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:10 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:10.611970 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:10.632163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f96792e0-fbbe-42b2-90c1-1d2adbf3486c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.179392 Aug 24 15:28:10.633116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 123/242] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:10 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:11.568417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:11.569371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:11.575478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:11.575962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:11.576528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:11.577108 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:11.577819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:11.580504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:11.654159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:11.656146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:11.664318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:11.665050 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:11.665640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:11.666752 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:11.667390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:11.667987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:11.735997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:11.749289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6f85d535-3240-4ab7-b2bf-bace627a4e21 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.185845 Aug 24 15:28:11.750432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 120/243] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:11 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:11.850466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:11.862426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bc2a87f0-8081-4fa8-933f-fd4a85d50ca4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.212740 Aug 24 15:28:11.878454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 124/244] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:11 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:12.770184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:12.773196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:12.779649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:12.780462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:12.780994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:12.781796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:12.782636 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:12.783260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:12.893515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:12.894293 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:12.904393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:12.905043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:12.905578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:12.906427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:12.907900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:12.908534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:13.037611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:13.046329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8404d93a-e32b-485f-b5ef-ffbdc1c89708 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.279987 Aug 24 15:28:13.059907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 121/245] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:12 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:13.066240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:13.075142 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-572ac9cd-d104-4877-83df-99198424b14d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.186122 Aug 24 15:28:13.075715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 125/246] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:12 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:14.067073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:14.067657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:14.090016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:14.100114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:14.101334 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:14.106882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:14.108825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:14.110627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:14.114859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:14.115324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:14.115808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:14.118168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:14.118639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:14.123655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:14.124423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:14.125016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:14.341154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:14.350204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-352760cb-f131-4d6c-8c9f-8f959208910e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.256983 Aug 24 15:28:14.351167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 126/247] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:14 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:14.426412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:14.448201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-10f5b8ec-67ac-4b1a-b73c-4768e8420627 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.381259 Aug 24 15:28:14.449269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 122/248] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:14 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:15.379621 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:15.381511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:15.392252 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:15.393854 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:15.394837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:15.396162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:15.396781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:15.398087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:15.469740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:15.471252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:15.486867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:15.487728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:15.488774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:15.490802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:15.493278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:15.494033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:15.692708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:15.703179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:15.723563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9d63f1db-567d-4865-8f8e-a94c6e19234c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.352844 Aug 24 15:28:15.724371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e1a9a3e5-c3f3-4e38-a65f-e8c094e4a64f tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.255998 Aug 24 15:28:15.740136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 127/250] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:15 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:15.740259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 123/250] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:15 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:15.753052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-7c433826-64ec-4d85-a91b-ab15c7f28652 req-b5e0db2b-09f4-4e6a-8b3f-93ae1a275169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11131c4b-e6e3-433c-868c-5174ff220680", "name": "network-vif-plugged", "status": "completed", "tag": "bd06d91b-2dd3-4a8f-b3bd-f2e1c896db08"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:15.768981 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-7c433826-64ec-4d85-a91b-ab15c7f28652 req-b5e0db2b-09f4-4e6a-8b3f-93ae1a275169 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:15.769465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-7c433826-64ec-4d85-a91b-ab15c7f28652 req-b5e0db2b-09f4-4e6a-8b3f-93ae1a275169 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:15.769895 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-7c433826-64ec-4d85-a91b-ab15c7f28652 req-b5e0db2b-09f4-4e6a-8b3f-93ae1a275169 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:15.792162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-7c433826-64ec-4d85-a91b-ab15c7f28652 req-b5e0db2b-09f4-4e6a-8b3f-93ae1a275169 service nova] Creating event network-vif-plugged:bd06d91b-2dd3-4a8f-b3bd-f2e1c896db08 for instance 11131c4b-e6e3-433c-868c-5174ff220680 on hv-cinder-84890 Aug 24 15:28:15.800032 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-7c433826-64ec-4d85-a91b-ab15c7f28652 req-b5e0db2b-09f4-4e6a-8b3f-93ae1a275169 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058349 Aug 24 15:28:15.801773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 128/251] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:15.822645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203832807", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "networks": [{"uuid": "c3a90c17-bb90-4723-9bdb-89bdcfa9e193"}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:15.934688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] validate_networks() for [('c3a90c17-bb90-4723-9bdb-89bdcfa9e193', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:28:16.733752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:28:16.734626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:28:16.734993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:28:16.736374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:28:16.736854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:28:16.750441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:16.751152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:16.759325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:16.759994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:16.760505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:16.761316 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:16.763421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:16.763981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:16.764205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:16.765903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:16.766459 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:16.768466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:16.769867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:16.771714 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:16.784384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Getting quotas for project 7292443f39f548e79c3bb9d07bccb0df. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:28:16.790958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Getting quotas for user 22ba5db8353847d7b14ba2d4cb391073 and project 7292443f39f548e79c3bb9d07bccb0df. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:28:16.807720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:28:16.812494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:28:16.880961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1f702548-0d05-4d8e-aafe-1acce068f4e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.064015 Aug 24 15:28:16.882421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 124/252] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:28:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:28:16.887761 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:16.888633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:16.895376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:16.896037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:16.896718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:16.897594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:16.898393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:16.899058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:17.150283 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:17.161630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5f6e6dd1-8a56-4ab0-89f2-4216a0bb67be tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.277946 Aug 24 15:28:17.165264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 125/253] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:16 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:17.182954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-672dae7c-931f-4530-9773-6f1407a13ea1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:17.184255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-672dae7c-931f-4530-9773-6f1407a13ea1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:17.308637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-672dae7c-931f-4530-9773-6f1407a13ea1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:17.318696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-672dae7c-931f-4530-9773-6f1407a13ea1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1213 microversion: 2.1 time: 0.150770 Aug 24 15:28:17.319633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 126/254] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:17 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:17.445553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:17.468798 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f13fa25a-cf68-4782-aa8c-23153946508e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.724060 Aug 24 15:28:17.471236 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 129/255] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:16 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:18.186350 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:18.187132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:18.193336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:18.201518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:18.203168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:18.204438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:18.205308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:18.207468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:18.345736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:18.347022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:18.355225 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:18.356572 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:18.359877 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:18.362311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:18.363527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:18.364177 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:18.431860 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:18.442817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4b8207d4-7880-4664-b582-44dd70138415 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.260805 Aug 24 15:28:18.444535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 127/256] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:18 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:18.486970 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:18.499248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:18.500199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:18.510932 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-aee32861-4b4e-4f15-9a4b-c15a4c1bdb59 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1265 microversion: 2.1 time: 0.169464 Aug 24 15:28:18.513288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:18.513770 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:18.514856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 130/257] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:18 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:18.515521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:18.516435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:18.517132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:18.517764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:18.543118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:18.711344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:18.720883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9f4fc3ff-511e-4212-9655-eeeb16120e73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.225708 Aug 24 15:28:18.726287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 128/258] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:18 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:19.161178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1563711106", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:19.243154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] validate_networks() for [('78a885ba-1e1d-4545-aad6-4c7a1fd937c3', None, None, None, None, None)] {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:28:19.464162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:19.466403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:19.492525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:19.493329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:19.496159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:19.497531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:19.498210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:19.499761 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:19.748112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:19.756415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-41e9fec8-bfa1-4e8d-b81e-3fa03675ef34 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1315 microversion: 2.1 time: 0.296485 Aug 24 15:28:19.758081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 129/259] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:19 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:19.766910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:19.767756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:19.783861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:19.784683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:19.785513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:19.786617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:19.787331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:19.787759 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:19.877812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:19.902511 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f0e51dad-e455-48b3-9645-5c33be5fe699 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1273 microversion: 2.1 time: 0.142885 Aug 24 15:28:19.908766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 130/260] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:19 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:19.932417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-259fc917-b0a8-4b2a-a623-dd3753e4980a req-70a8d2cb-60be-4b74-bf81-f74ad1ef38f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d102fd3a-a604-4ee9-a585-64564a60a2c3", "name": "network-vif-plugged", "status": "completed", "tag": "82bca62b-0802-4d60-8002-d5fe93d1d6b8"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:19.949207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-259fc917-b0a8-4b2a-a623-dd3753e4980a req-70a8d2cb-60be-4b74-bf81-f74ad1ef38f3 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:19.951362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-259fc917-b0a8-4b2a-a623-dd3753e4980a req-70a8d2cb-60be-4b74-bf81-f74ad1ef38f3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:19.952876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-259fc917-b0a8-4b2a-a623-dd3753e4980a req-70a8d2cb-60be-4b74-bf81-f74ad1ef38f3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:19.973754 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-259fc917-b0a8-4b2a-a623-dd3753e4980a req-70a8d2cb-60be-4b74-bf81-f74ad1ef38f3 service nova] Creating event network-vif-plugged:82bca62b-0802-4d60-8002-d5fe93d1d6b8 for instance d102fd3a-a604-4ee9-a585-64564a60a2c3 on hv-cinder-84890 Aug 24 15:28:19.982755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-259fc917-b0a8-4b2a-a623-dd3753e4980a req-70a8d2cb-60be-4b74-bf81-f74ad1ef38f3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072114 Aug 24 15:28:19.983820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 131/261] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:19.992757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:19.993848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:20.011740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:20.012856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:20.013484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:20.014623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:20.015148 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:20.015579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:20.420772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:20.487041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1ec1edc8-72a8-455e-b0fe-19f979812f00 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.497791 Aug 24 15:28:20.490585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 132/262] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:19 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:20.781482 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:20.783264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:20.800776 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:20.801639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:20.802681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:20.803891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:20.808360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:20.809875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.095777 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:21.108264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c1a99716-8d5c-488a-ada2-448c24bef2b2 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1465 microversion: 2.1 time: 0.333701 Aug 24 15:28:21.109371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 133/263] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:20 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1465 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:21.116632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:21.117960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:21.125228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.125971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.126545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.127184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.127657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.128044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.134115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:28:21.134633 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:28:21.135060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:28:21.135477 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:28:21.135899 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:28:21.152926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.153421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.153858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.154630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.155079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.162844 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.193023 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:28:21.197540 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for user 461b9a3987744067a62234aaa8d086d0 and project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:28:21.229245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:28:21.232237 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:28:21.255048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:21.264498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7e9738e1-1877-4807-94d9-d9d538e11e6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1271 microversion: 2.1 time: 0.153232 Aug 24 15:28:21.270401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 134/264] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:21 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:21.283090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:21.283894 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:21.299685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.300468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.302675 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.303682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.304622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.307029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.354199 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b7954b92-7f22-4f83-80a9-cc0b566fd410 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.526550 Aug 24 15:28:21.359549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 131/265] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:28:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:28:21.369559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:28:21.378427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cdaa9633-729a-4c51-a04a-0594e5525004 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:21.382039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-cdaa9633-729a-4c51-a04a-0594e5525004 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:21.495566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cdaa9633-729a-4c51-a04a-0594e5525004 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:21.507931 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cdaa9633-729a-4c51-a04a-0594e5525004 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1222 microversion: 2.1 time: 0.142300 Aug 24 15:28:21.509077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 132/266] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:21 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:21.514633 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:21.515566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:21.523086 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.523783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.524362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.525212 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.526043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.526883 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.687222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-04855cfa-ba85-49de-bd83-4a680bee1671 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "DELETE /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 204 len: 0 microversion: 2.1 time: 0.415157 Aug 24 15:28:21.688714 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 135/267] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:28:21 2022] DELETE /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:28:21.696031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1887886804", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:21.773744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] validate_networks() for [('78a885ba-1e1d-4545-aad6-4c7a1fd937c3', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:28:21.932381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:21.945068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e3e32041-4a83-4a4e-8522-672830c0726f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.434661 Aug 24 15:28:21.946028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 133/268] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:21 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:21.951085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:21.951713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:21.960865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.961886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.962614 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:21.963827 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:21.964450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:21.965634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:22.371949 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:22.375795 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:22.381299 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d3aab027-d8d8-4791-b17a-815c44345454 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1471 microversion: 2.1 time: 0.433836 Aug 24 15:28:22.387797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 134/269] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:21 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:22.398515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:22.400690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:22.415227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:22.415826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:22.416358 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:22.419792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:22.420265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:22.420690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:22.563546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:28:22.564069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:28:22.564647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:28:22.565174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:28:22.565689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:28:22.576203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:22.577090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:22.577807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:22.578771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:22.579738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:22.580393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:22.602702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:28:22.608001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for user 461b9a3987744067a62234aaa8d086d0 and project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:28:22.613853 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:22.621927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:28:22.624480 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-80f8742d-df7c-4d3f-8011-de816b64654a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.235543 Aug 24 15:28:22.624901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:28:22.626082 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 135/270] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:22 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:22.684450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-75fa074b-fdfc-4897-882a-f996fc564c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.994203 Aug 24 15:28:22.685533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 136/271] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:28:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:28:22.697269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c7fb483a-b100-4500-b82f-9b90d02b60c4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:22.698754 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c7fb483a-b100-4500-b82f-9b90d02b60c4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:22.779862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c7fb483a-b100-4500-b82f-9b90d02b60c4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:22.788259 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c7fb483a-b100-4500-b82f-9b90d02b60c4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1222 microversion: 2.1 time: 0.095632 Aug 24 15:28:22.789484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 136/272] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:22 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:22.965449 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:22.966700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:22.973428 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:22.974302 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:22.975202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:22.976256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:22.977153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:22.977728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.129226 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:23.140620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6935a8fd-0f70-41f3-a7fb-042e89bb14f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1319 microversion: 2.1 time: 0.179346 Aug 24 15:28:23.154061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 137/273] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:22 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:23.415258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:23.415880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:23.425336 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:23.425624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:23.426242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.426881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:23.427342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:23.427902 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.651029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:23.651756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:23.660776 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:23.661610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:23.662271 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.662991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:23.663446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:23.663898 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.733860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:23.744387 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d4a219b1-f064-4c74-9b3d-b9890f3baa07 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1471 microversion: 2.1 time: 0.333544 Aug 24 15:28:23.759683 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 137/274] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:23 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:23.810367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:23.811327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:23.813330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:23.818016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:23.818728 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:23.819168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.819874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:23.820495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:23.820939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:23.822818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c2ab1e3e-5bb6-4339-bf49-c3fd6492d79c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.175859 Aug 24 15:28:23.823478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 138/275] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:23 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:23.914071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:23.950368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9c4a2c0d-5713-4412-8ebf-653747bb3611 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1226 microversion: 2.1 time: 0.143612 Aug 24 15:28:23.967651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 138/276] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:23 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:24.163774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:24.165202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:24.179340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:24.181370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:24.182200 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:24.183432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:24.184432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:24.185271 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:24.508241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:24.520053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0a26899a-f0ea-4a83-82ee-7ff7490b8c18 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1508 microversion: 2.1 time: 0.362845 Aug 24 15:28:24.521656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 139/277] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:24 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1508 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:24.767058 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:24.768208 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:24.779046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:24.780439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:24.780439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:24.780780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:24.781136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:24.781566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:24.844050 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:24.844654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:24.853595 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:24.854087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:24.854544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:24.855242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:24.856232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:24.856657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:25.121745 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:25.131180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-141a4c17-9ee1-4998-bcff-f60243c239d6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.291105 Aug 24 15:28:25.145078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 140/278] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:24 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:25.150433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-5ac1b021-778a-4d1f-9f3e-fdbb9421fb0e req-46823a9c-443f-4f8e-b0a5-adc1621cecdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b39e72e-2601-4952-b79a-ee4848035902", "tag": "096223ce-909d-40e1-8262-1a6ca6a5867a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:25.160886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-5ac1b021-778a-4d1f-9f3e-fdbb9421fb0e req-46823a9c-443f-4f8e-b0a5-adc1621cecdc service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:25.161367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-5ac1b021-778a-4d1f-9f3e-fdbb9421fb0e req-46823a9c-443f-4f8e-b0a5-adc1621cecdc service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:25.161802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-5ac1b021-778a-4d1f-9f3e-fdbb9421fb0e req-46823a9c-443f-4f8e-b0a5-adc1621cecdc service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:25.176866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-5ac1b021-778a-4d1f-9f3e-fdbb9421fb0e req-46823a9c-443f-4f8e-b0a5-adc1621cecdc service nova] Creating event network-changed:096223ce-909d-40e1-8262-1a6ca6a5867a for instance 7b39e72e-2601-4952-b79a-ee4848035902 on hv-cinder-84890 Aug 24 15:28:25.184669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-5ac1b021-778a-4d1f-9f3e-fdbb9421fb0e req-46823a9c-443f-4f8e-b0a5-adc1621cecdc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037331 Aug 24 15:28:25.185523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 141/279] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:25.190986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:25.191973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:25.196976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:25.200305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:25.201033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:25.201871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:25.203733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:25.205366 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:25.206804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9981ff73-dea0-4c4e-b884-4cbe0b2d9f65 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1471 microversion: 2.1 time: 0.444527 Aug 24 15:28:25.207785 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:25.215616 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 139/280] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:24 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:25.330524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:25.339470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2d43bcf5-9528-4122-b0e5-dd26bddc3020 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1274 microversion: 2.1 time: 0.152531 Aug 24 15:28:25.340659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 142/281] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:25 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:26.152604 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:26.153217 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:26.160841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:26.161332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:26.161770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:26.162509 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:26.162967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:26.163397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:26.241059 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:26.241705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:26.249370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:26.250383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:26.251784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:26.252982 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:26.253543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:26.254034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:26.314418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:26.324991 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a20e6dc8-2cbf-451f-b108-b1b06854947a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.176085 Aug 24 15:28:26.325808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 140/282] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:26 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:26.342596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:26.350711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1ea0357c-d5b2-4aae-89b5-10d3209a6e58 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1429 microversion: 2.1 time: 0.114739 Aug 24 15:28:26.351292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 143/283] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:26 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:26.363427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:26.364504 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:26.370869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:26.371899 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:26.372337 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:26.373051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:26.373506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:26.373925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:26.436195 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:26.444603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-33c0615b-0115-4496-beca-3c7dccca4cae tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1274 microversion: 2.1 time: 0.085043 Aug 24 15:28:26.445164 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 141/284] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:26 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:27.223493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-6b990e6b-f3f4-4a3e-a12e-a07de40e80d9 req-e0f5e2f7-4fb8-4e92-adda-aa14f4dc5d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11131c4b-e6e3-433c-868c-5174ff220680", "name": "network-vif-deleted", "tag": "bd06d91b-2dd3-4a8f-b3bd-f2e1c896db08"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:27.234203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6b990e6b-f3f4-4a3e-a12e-a07de40e80d9 req-e0f5e2f7-4fb8-4e92-adda-aa14f4dc5d4f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.234708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6b990e6b-f3f4-4a3e-a12e-a07de40e80d9 req-e0f5e2f7-4fb8-4e92-adda-aa14f4dc5d4f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.235144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6b990e6b-f3f4-4a3e-a12e-a07de40e80d9 req-e0f5e2f7-4fb8-4e92-adda-aa14f4dc5d4f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.247003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-6b990e6b-f3f4-4a3e-a12e-a07de40e80d9 req-e0f5e2f7-4fb8-4e92-adda-aa14f4dc5d4f service nova] Creating event network-vif-deleted:bd06d91b-2dd3-4a8f-b3bd-f2e1c896db08 for instance 11131c4b-e6e3-433c-868c-5174ff220680 on hv-cinder-84890 Aug 24 15:28:27.254870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-6b990e6b-f3f4-4a3e-a12e-a07de40e80d9 req-e0f5e2f7-4fb8-4e92-adda-aa14f4dc5d4f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Aug 24 15:28:27.255488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 144/285] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:27.347800 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:27.354325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:27.356155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.356756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.357238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.358145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.358762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.359353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.372755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:27.373824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:27.382783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.383599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.384342 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.385787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.387455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.388781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.468170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:27.478465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aba30453-8e0d-48e2-b295-54867571622d tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1429 microversion: 2.1 time: 0.110690 Aug 24 15:28:27.479178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 145/286] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:27 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:27.490485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:27.490485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:27.494331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.494956 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.495525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.496906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:27.497460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:27.497985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:27.501160 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:27.577512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:27.580995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:27.585840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4af2fd87-7bd2-4219-b00b-719d84a47852 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.242540 Aug 24 15:28:27.594265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 142/287] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:27 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:27.594502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-023cd828-a8c7-4d2e-94cc-aa4d25e638a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1274 microversion: 2.1 time: 0.109209 Aug 24 15:28:27.594502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 146/288] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:27 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:28.523538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:28.525409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:28.555811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.557774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.559593 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.561201 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.562277 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.563277 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.610896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:28.611747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:28.613393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:28.619291 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.619987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.620640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.621477 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lazy-loading 'fault' on Instance uuid 11131c4b-e6e3-433c-868c-5174ff220680 {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:28:28.627157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.629684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.631160 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.633615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.635002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.635850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.675761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c2101de3874d9ab296aa1e6b5e9b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63eb112769442ddbbe718fd4169cac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:28.684762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b126249d-3413-4d27-aad0-b516f76299a0 tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 200 len: 1305 microversion: 2.1 time: 0.187039 Aug 24 15:28:28.685888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 143/289] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:28 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 1305 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:28.690837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:28.694171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:28.701342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.701828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.702281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.702981 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:28.703429 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:28.703857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:28.721225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:28.729686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-dadd1af1-7ce8-440c-b2f2-1e78d2761cd6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1282 microversion: 2.1 time: 0.122630 Aug 24 15:28:28.730367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 147/290] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:28 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1282 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:29.134495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:29.148890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d11e3b4c-29c0-47fc-9fe4-6e43760a31d0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.461884 Aug 24 15:28:29.150642 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 144/291] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:28 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:29.712341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:29.713009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] [instance: 11131c4b-e6e3-433c-868c-5174ff220680] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:29.719610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:29.721578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:29.722200 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:29.722970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:29.723410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:29.723838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:29.744161 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] HTTP exception thrown: Instance 11131c4b-e6e3-433c-868c-5174ff220680 could not be found. Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Request method failure captured: Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 HTTP/1.1 Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkNtfB6oxTuXagKLUU10jPjUdTc7EaJlijxVUsFfZcdPKIe2tGGQFavv8dIH2HFwbdp_YhWelLCGgEDvZN8cVnAr0pKKclJBHp_KHEDL08scaOeeET_n28sfrRWhV0NhsTkr4museWFxWGNfCHA-fj_VUNSUdcWdThrXo8ceSTjFcyk Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: f63eb112769442ddbbe718fd4169cac7 Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesNegativeTest-1258309774 Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:28:29.750813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/f63eb112769442ddbbe718fd4169cac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f63eb112769442ddbbe718fd4169cac7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_f63eb112769442ddbbe718fd4169cac7", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/f63eb112769442ddbbe718fd4169cac7"}]}] Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesNegativeTest-1258309774 Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: f63eb112769442ddbbe718fd4169cac7 Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesNegativeTest-1258309774 Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesNegativeTest-1258309774-project Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 23c2101de3874d9ab296aa1e6b5e9b2c Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesNegativeTest-1258309774-project Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 11131c4b-e6e3-433c-868c-5174ff220680 could not be found. Aug 24 15:28:29.754191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '11131c4b-e6e3-433c-868c-5174ff220680'} Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11131c4b-e6e3-433c-868c-5174ff220680 could not be found. Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:28:29.756858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11131c4b-e6e3-433c-868c-5174ff220680 could not be found. Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11131c4b-e6e3-433c-868c-5174ff220680 could not be found. Aug 24 15:28:29.762876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:28:29.764892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:29.764892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:29.765820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] Returning 404 to user: Instance 11131c4b-e6e3-433c-868c-5174ff220680 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:28:29.768717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6ddbcaad-9d61-43db-8ed0-3206af58fb9a tempest-VolumesNegativeTest-1258309774 tempest-VolumesNegativeTest-1258309774-project] 10.222.0.76 "GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680" status: 404 len: 111 microversion: 2.1 time: 0.065302 Aug 24 15:28:29.769487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 148/292] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:29 2022] GET /compute/v2.1/servers/11131c4b-e6e3-433c-868c-5174ff220680 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:28:29.775578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:29.776377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:29.777057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:29.778572 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:29.779224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:29.779844 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:29.924209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:29.937215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-af1f9ba9-2317-49ab-b820-27f2a7912fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1280 microversion: 2.1 time: 0.182475 Aug 24 15:28:29.939174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 145/293] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:29 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:30.176572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:30.177490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:30.187389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:30.188716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:30.189756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:30.191300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:30.192382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:30.193749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:30.389065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:30.410823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7de6f446-3373-4e95-bca6-c5f18adaa44c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.238103 Aug 24 15:28:30.411609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 149/294] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:30 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:30.971161 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:30.972361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:30.985206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:30.985831 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:30.986547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:30.987666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:30.988461 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:30.989676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:31.174950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:31.300571 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:31.309404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6e8e5371-cca9-419c-b339-095f826b7d24 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.345997 Aug 24 15:28:31.330447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 146/295] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:30 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:31.436408 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:31.437329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:31.444971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:31.445899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:31.446638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:31.447600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:31.448197 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:31.448766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:31.645732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:31.656424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e65d2871-1a21-403e-8342-c85f524b755a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.225091 Aug 24 15:28:31.663673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 150/296] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:31 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:32.333031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:32.333959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:32.344305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:32.345262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:32.346158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:32.347796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:32.348813 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:32.349621 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:32.540189 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:32.549849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0c951824-716a-4b3c-8e16-4fbcd816ff42 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.221041 Aug 24 15:28:32.550693 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 147/297] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:32 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:32.682389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:32.683006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:32.685216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:32.686017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=14 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:32.692787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:32.693194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:32.693639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:32.694409 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:32.694851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:32.695259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:32.870929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:32.886003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-efaf09ab-a586-4916-8b2c-6b59ced74b28 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.208337 Aug 24 15:28:32.887367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 151/298] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:32 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:33.571981 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:33.572797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:33.579611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=10 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:33.582265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:33.582740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:33.583183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:33.583916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:33.584340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:33.585083 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:33.770556 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:33.779204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0820a18c-9562-49eb-8db4-70577f429a71 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.211697 Aug 24 15:28:33.779762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 148/299] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:33 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:33.924222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:33.924842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:33.931389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:33.931874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:33.932313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:33.933010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:33.934079 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:33.934544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:34.075285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:34.083891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aa2a2769-2c86-419f-b014-cf090e7197e5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.164140 Aug 24 15:28:34.084452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 152/300] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:33 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:34.799752 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:34.800357 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:34.807113 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:34.807762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:34.808197 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:34.808905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:34.809379 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:34.809802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:34.940719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:34.949792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c770b42c-e92f-44a5-b0cc-ab59ed23a92c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.153172 Aug 24 15:28:34.950389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 149/301] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:34 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:35.103873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:35.104756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:35.110699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:35.111180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:35.111601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:35.112270 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:35.112709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:35.113120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:35.243431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:35.251622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-854e2447-274b-40aa-9932-9fd4a0fab2d8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.151487 Aug 24 15:28:35.252178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 153/302] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:35 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:35.971555 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:35.972157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:35.973972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:35.979551 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:35.980024 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:35.980484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:35.981163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:35.981617 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:35.982024 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:36.270204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:36.272011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:36.272608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:36.278327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fa83d1ab-3432-4d45-9031-06dfa2c71666 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.310856 Aug 24 15:28:36.278891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:36.279097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 150/303] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:35 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:36.280174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:36.280616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:36.281330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:36.281791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:36.282274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:36.414532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:36.422660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6ad45c51-bbb0-40e2-914f-b49c5c5cad06 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.154337 Aug 24 15:28:36.423231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 154/304] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:36 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:37.300695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:37.304484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:37.312596 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:37.313087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:37.313530 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:37.314259 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:37.314720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:37.315348 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:37.445033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:37.445923 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:37.453445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:37.453929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:37.454397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:37.455082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:37.455527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:37.455943 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:37.626369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:37.634513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ec72629e-77f0-448b-b4c7-89c73d566fa6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.338779 Aug 24 15:28:37.635083 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 151/305] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:37 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:37.642647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:37.663304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9449b76c-9adc-475e-b188-72bbe2498565 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.222655 Aug 24 15:28:37.664233 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 155/306] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:37 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:37.820043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-bdbbf9c7-5e2d-46b8-aa4c-4dab3b6fe4ed req-b6cf97a2-c963-4cf0-a9d0-29bdf2b29552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f66ab1-18d5-41d8-b752-d6a00fd893b4", "tag": "a94c617a-233e-4bf8-b514-c995148f2911"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:37.831496 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-bdbbf9c7-5e2d-46b8-aa4c-4dab3b6fe4ed req-b6cf97a2-c963-4cf0-a9d0-29bdf2b29552 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:37.832039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-bdbbf9c7-5e2d-46b8-aa4c-4dab3b6fe4ed req-b6cf97a2-c963-4cf0-a9d0-29bdf2b29552 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:37.832737 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-bdbbf9c7-5e2d-46b8-aa4c-4dab3b6fe4ed req-b6cf97a2-c963-4cf0-a9d0-29bdf2b29552 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:37.839016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:37.852303 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-bdbbf9c7-5e2d-46b8-aa4c-4dab3b6fe4ed req-b6cf97a2-c963-4cf0-a9d0-29bdf2b29552 service nova] Creating event network-changed:a94c617a-233e-4bf8-b514-c995148f2911 for instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 on hv-cinder-84890 Aug 24 15:28:37.859578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-bdbbf9c7-5e2d-46b8-aa4c-4dab3b6fe4ed req-b6cf97a2-c963-4cf0-a9d0-29bdf2b29552 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042729 Aug 24 15:28:37.860492 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 152/307] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:28:38.656523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:38.657853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:38.664344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:38.664827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:38.665252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:38.665992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:38.666464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:38.666881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:38.686407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:38.687834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:38.694490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:38.694971 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:38.695409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:38.696115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:38.696673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:38.697163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:38.821162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:38.829572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c9541799-4f54-4e01-b5f8-bf6fa2142c55 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.177783 Aug 24 15:28:38.830140 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 156/308] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:38 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:38.854790 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:38.863744 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3634755d-fde1-4af6-9362-4508d343eeb7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.182299 Aug 24 15:28:38.864293 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 153/309] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:38 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:39.861336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:39.862471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:39.874093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:39.874788 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:39.875346 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:39.876473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:39.877053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:39.877592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:39.890195 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-d1d104b5-9627-4541-8379-0b5af6c027ca req-21a2bb48-2cdd-47b0-b73f-6b2f3dfb4558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906ae0b-2d03-4ffb-b754-4580ba86246d", "tag": "6943cc7e-9b9d-44dd-bac6-c74c7014e3b5"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:39.909221 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d1d104b5-9627-4541-8379-0b5af6c027ca req-21a2bb48-2cdd-47b0-b73f-6b2f3dfb4558 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:39.909898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d1d104b5-9627-4541-8379-0b5af6c027ca req-21a2bb48-2cdd-47b0-b73f-6b2f3dfb4558 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:39.910522 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d1d104b5-9627-4541-8379-0b5af6c027ca req-21a2bb48-2cdd-47b0-b73f-6b2f3dfb4558 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:39.928794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-d1d104b5-9627-4541-8379-0b5af6c027ca req-21a2bb48-2cdd-47b0-b73f-6b2f3dfb4558 service nova] Creating event network-changed:6943cc7e-9b9d-44dd-bac6-c74c7014e3b5 for instance 5906ae0b-2d03-4ffb-b754-4580ba86246d on hv-cinder-84890 Aug 24 15:28:39.938037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-d1d104b5-9627-4541-8379-0b5af6c027ca req-21a2bb48-2cdd-47b0-b73f-6b2f3dfb4558 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055204 Aug 24 15:28:39.939300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 154/310] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:39.956875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:39.957625 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:39.967638 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:39.968183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:39.968660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:39.969795 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:39.970666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:39.971276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:40.074630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:40.087101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-67eb3536-dd09-4e7c-9697-bc4911f8337a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.238880 Aug 24 15:28:40.088320 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 157/311] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:39 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:40.140744 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:40.154400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7cc8f1b5-9b94-4e65-803f-f890b0e9e60e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.208210 Aug 24 15:28:40.158548 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 155/312] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:39 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:41.113414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:41.115625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:41.131393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:41.131912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:41.132356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:41.136653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:41.137257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:41.137805 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:41.177355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:41.177932 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:41.187172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:41.188127 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:41.193614 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:41.195012 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:41.195652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:41.196267 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:41.633267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:41.641886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a0df16de-3e32-4527-a496-ce891a99ab3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.533311 Aug 24 15:28:41.654959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 158/313] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:41 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:41.826838 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:41.834341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1431cc55-0246-49c5-a52c-b483be4ff1cb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.661169 Aug 24 15:28:41.834908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 156/314] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:41 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:42.664341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:42.664971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:42.670934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:42.671411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:42.671841 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:42.672538 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:42.674016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:42.674911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:42.837674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:42.845662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b32bb335-2430-4448-808c-a24a0a770fab tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.185101 Aug 24 15:28:42.846254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 159/315] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:42 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:42.856419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:42.857674 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:42.864237 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:42.864719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:42.865148 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:42.865850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:42.866331 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:42.866753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:43.021215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:43.029682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d27cfcaf-1a55-4346-a324-c6349253d0b0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.178126 Aug 24 15:28:43.030274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 157/316] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:42 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:43.868755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:43.870327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:43.878185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:43.878718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:43.879110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:43.879807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:43.880248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:43.880848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:44.034138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:44.043346 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-eda8d679-9589-4d80-86cd-ed2acc356db3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.179234 Aug 24 15:28:44.044733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 160/317] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:43 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:44.051818 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:44.052643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:44.061641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:44.062165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:44.062691 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:44.063577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:44.064174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:44.064695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:44.215360 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:44.228009 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a355c14e-6906-4cc5-b560-1e3b577d1d69 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.175102 Aug 24 15:28:44.228741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 158/318] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:44 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:45.065069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:45.065706 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:45.073444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:45.074529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:45.074975 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:45.075712 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:45.076316 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:45.076774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:45.247495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:45.249962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:45.250598 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:45.255812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8d7021ad-29e6-48ee-969e-087adcdf87b8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.194598 Aug 24 15:28:45.256436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 161/319] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:45 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:45.258938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:45.259455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:45.260745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:45.261994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:45.262811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:45.263776 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:45.428105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:45.437935 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bd153ee2-d11a-451b-875c-759ba3241817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.191604 Aug 24 15:28:45.438566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 159/320] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:45 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:46.279360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:46.279883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:46.286181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:46.286698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:46.287159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:46.287854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:46.288299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:46.288729 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:46.443681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:46.452146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c14d183e-1112-4a18-85b7-70c5a89dc69d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.177346 Aug 24 15:28:46.453830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 162/321] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:46 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:46.459615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:46.460435 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:46.467202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:46.467681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:46.468110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:46.468796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:46.469242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:46.469739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:46.608578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:46.616999 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6c66aba6-4b95-4258-8527-c068e42fc3b8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.161099 Aug 24 15:28:46.617673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 160/322] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:46 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:47.475041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:47.476011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:47.485837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:47.486645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:47.487367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:47.488463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:47.488960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:47.489422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:47.506174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:47.629178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:47.637432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7bbc7291-7f94-4682-a14a-4f424ec6d8d8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.168397 Aug 24 15:28:47.637984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 163/323] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:47 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:47.638473 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:47.639097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:47.645628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:47.646194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:47.646725 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:47.647481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:47.648002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:47.648488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:47.785827 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:47.795664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f0faac70-b4b2-4c86-bb46-2f126020d359 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.161011 Aug 24 15:28:47.796220 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 161/324] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:47 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:48.658484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:48.659191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:48.665899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:48.666441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:48.666880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:48.667585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:48.668039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:48.668469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:48.817489 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:48.819070 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:48.827077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:48.827675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:48.828324 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:48.829160 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:48.829300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:48.830735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:48.830735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:48.842313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-369c25ac-bb74-4683-bf65-fe486b3f1d3d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.187841 Aug 24 15:28:48.842889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 164/325] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:48 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:48.984116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:48.992019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-441259cc-e596-4ed4-990d-fcd37873c4ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.178882 Aug 24 15:28:48.992776 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 162/326] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:48 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:49.863649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:49.864264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:49.870291 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:49.870808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:49.871243 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:49.871935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:49.872383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:49.872803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:50.013393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:50.014315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:50.020388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:50.020881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:50.021314 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:50.022021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:50.022514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:50.022939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:50.031774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:50.044897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ca2ad5d3-f8fe-4397-9893-eb613a4adcbb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.185311 Aug 24 15:28:50.045615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 165/327] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:49 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:50.163801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:50.171757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e824a804-9b25-48db-bcc9-bda9a3ae6006 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.163126 Aug 24 15:28:50.172327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 163/328] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:50 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:51.066429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:51.067042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:51.073095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:51.074091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:51.074561 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:51.075857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:51.075857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:51.076116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:51.193191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:51.193875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:51.203275 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:51.204119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:51.205117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:51.206136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:51.206767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:51.207343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:51.212260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:51.221117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-36da19f3-e868-44f7-a29a-923cac1ff94b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.158582 Aug 24 15:28:51.222201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 166/329] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:51 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:51.358867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:51.372213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e8bdb4d4-09c0-4531-8c9c-c338a0361ddf tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.178820 Aug 24 15:28:51.372213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 164/330] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:51 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:52.243940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:52.244977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:52.252991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:52.253504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:52.253940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:52.254665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:52.255118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:52.255546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:52.392599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:52.393229 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:52.419616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:52.420836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:52.421369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:52.421821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:52.422570 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:52.423209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:52.423816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:52.428880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1b479ede-b898-41b9-9462-2f4979eb6de0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.190390 Aug 24 15:28:52.429888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 167/331] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:52 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:52.580320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:52.589329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2bd554f1-cfac-43cb-b1aa-444ed59590bb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.203006 Aug 24 15:28:52.589901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 165/332] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:52 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:53.450421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:53.451064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:53.457801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.458328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.458935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.459640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.460121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.460722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.612791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:53.613403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:53.617948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:53.626942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c6b82027-3a03-4b84-a530-9a99a5d8cee5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.180133 Aug 24 15:28:53.627444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 168/333] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:53 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:53.644469 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.644960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.645586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.646712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:53.647302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:53.647858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:53.908808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:53.919077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f679ab7b-179d-4551-af04-2b617bd7db6d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.312269 Aug 24 15:28:53.919977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 166/334] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:53 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:28:54.190203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-34415b95-3274-446c-b72e-ac47445f6014 req-ed2e0d33-2eec-4fdf-8c85-3408764e3857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b39e72e-2601-4952-b79a-ee4848035902", "name": "network-vif-plugged", "status": "completed", "tag": "096223ce-909d-40e1-8262-1a6ca6a5867a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:28:54.200328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-34415b95-3274-446c-b72e-ac47445f6014 req-ed2e0d33-2eec-4fdf-8c85-3408764e3857 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:54.200800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-34415b95-3274-446c-b72e-ac47445f6014 req-ed2e0d33-2eec-4fdf-8c85-3408764e3857 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:54.201224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-34415b95-3274-446c-b72e-ac47445f6014 req-ed2e0d33-2eec-4fdf-8c85-3408764e3857 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:54.213149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-34415b95-3274-446c-b72e-ac47445f6014 req-ed2e0d33-2eec-4fdf-8c85-3408764e3857 service nova] Creating event network-vif-plugged:096223ce-909d-40e1-8262-1a6ca6a5867a for instance 7b39e72e-2601-4952-b79a-ee4848035902 on hv-cinder-84890 Aug 24 15:28:54.218752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-34415b95-3274-446c-b72e-ac47445f6014 req-ed2e0d33-2eec-4fdf-8c85-3408764e3857 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Aug 24 15:28:54.219451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 169/335] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:28:54.648171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:54.648783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:54.655517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:54.656004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:54.656438 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:54.657138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:54.657867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:54.658325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:54.795289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:54.802951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-921ad723-e0e7-4a7c-8a43-3071a37fc23a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.158641 Aug 24 15:28:54.803511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 167/336] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:54 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:54.944335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:54.945456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:54.954625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:54.955112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:54.955844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:54.957102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:54.958461 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:54.959392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:55.146672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:55.155817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9037921f-fa91-4df4-83c4-4bcb16c67de4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.216005 Aug 24 15:28:55.156855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 170/337] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:54 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:55.823029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:55.824210 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:55.830601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:55.831090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:55.831528 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:55.832225 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:55.832684 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:55.833108 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:55.978933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:55.987033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-69d49209-f437-431e-93af-79c4776c31fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.167773 Aug 24 15:28:55.987799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 168/338] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:55 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:56.191934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:56.192632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:56.199426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:56.199934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:56.200537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:56.201289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:56.201673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:56.202090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:56.344143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:56.352507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-681c4625-5c09-4187-b684-e6a1504448d4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.165467 Aug 24 15:28:56.353082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 171/339] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:56 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:57.009770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:57.010464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:57.017640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:57.018059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:57.018533 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:57.019241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:57.019724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:57.020147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:57.160670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:57.169116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-044f7933-df1d-428c-bb82-700b1dd03737 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.164325 Aug 24 15:28:57.169687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 169/340] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:57 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:57.384154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:57.385264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:57.392937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:57.393418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:57.393902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:57.394629 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:57.395337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:57.395769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:57.554838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:57.567324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fbc481d2-29f1-404c-b47f-8d56b87a9d77 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.188063 Aug 24 15:28:57.581448 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 172/341] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:57 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:58.194001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:58.194665 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:58.202018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:58.202542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:58.202979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:58.204035 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:58.204926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:58.205508 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:58.210265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:58.358757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:58.367130 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0f452251-ac08-4259-822c-487ff2d39174 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.178236 Aug 24 15:28:58.367708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 170/342] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:58 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:58.589901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:58.590550 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:58.597042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:58.597524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:58.597958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:58.598680 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:58.599135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:58.599562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:58.728400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:58.737216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9d301a89-a43b-44de-9f2b-77846e49d843 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.151016 Aug 24 15:28:58.737810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 173/343] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:58 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:59.388030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:59.388649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:59.395250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:59.395738 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:59.396181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:59.396886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:59.397345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:59.397772 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:59.601087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:59.610515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-68301084-7ac1-4b8c-906d-4b43adb833fd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.225808 Aug 24 15:28:59.611202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 171/344] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:59 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:28:59.759941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:28:59.760782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:28:59.765738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=54 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:28:59.769623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:59.770040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:59.770550 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:59.771202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:28:59.771653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:28:59.772108 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:28:59.911633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:28:59.920375 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-95f1803d-5f3c-4eb3-b2d8-806453d5ccac tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.164670 Aug 24 15:28:59.920984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 174/345] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:28:59 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:00.634092 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:00.634880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:00.642388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:00.643061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:00.643454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:00.644161 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:00.644616 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:00.645387 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:00.825837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:00.835719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7cee6f74-3515-4166-8930-c005d872d0fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.204671 Aug 24 15:29:00.836312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 172/346] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:00 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:00.941130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:00.941741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:00.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:00.950067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:00.950587 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:00.951358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:00.951880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:00.952417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:01.057821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-ec474ffe-8371-4580-afe6-2dfd721f20ab req-b705316d-9a9f-418f-afdf-669cdbec72bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906ae0b-2d03-4ffb-b754-4580ba86246d", "name": "network-vif-plugged", "status": "completed", "tag": "6943cc7e-9b9d-44dd-bac6-c74c7014e3b5"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:01.073862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-ec474ffe-8371-4580-afe6-2dfd721f20ab req-b705316d-9a9f-418f-afdf-669cdbec72bb service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:01.074407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-ec474ffe-8371-4580-afe6-2dfd721f20ab req-b705316d-9a9f-418f-afdf-669cdbec72bb service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:01.074855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-ec474ffe-8371-4580-afe6-2dfd721f20ab req-b705316d-9a9f-418f-afdf-669cdbec72bb service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:01.092775 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-ec474ffe-8371-4580-afe6-2dfd721f20ab req-b705316d-9a9f-418f-afdf-669cdbec72bb service nova] Creating event network-vif-plugged:6943cc7e-9b9d-44dd-bac6-c74c7014e3b5 for instance 5906ae0b-2d03-4ffb-b754-4580ba86246d on hv-cinder-84890 Aug 24 15:29:01.104358 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-ec474ffe-8371-4580-afe6-2dfd721f20ab req-b705316d-9a9f-418f-afdf-669cdbec72bb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050949 Aug 24 15:29:01.105433 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 173/347] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:29:01.118749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:01.128065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6e73183d-f8f6-40bc-97fb-9a35bb4b96bd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.190718 Aug 24 15:29:01.128541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 175/348] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:00 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:01.860224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:01.861034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:01.869134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:01.869639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:01.870128 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:01.870858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:01.871344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:01.871806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:02.005032 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:02.013365 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b987bb44-8d55-4988-9431-3ae827084217 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.160165 Aug 24 15:29:02.013933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 174/349] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:01 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:02.149955 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:02.150590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:02.156529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:02.156998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:02.157422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:02.158385 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:02.158829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:02.159243 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:02.285247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:02.293273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aec41fdc-a466-4b5d-ae22-d3ab8e15deb9 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.147077 Aug 24 15:29:02.293859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 176/350] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:02 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:03.034464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:03.036048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:03.041507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:03.041997 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:03.042467 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:03.043237 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:03.043698 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:03.044123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:03.207344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:03.220594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-63bd0ff7-b764-46e4-86b1-2c47c85f626d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.190727 Aug 24 15:29:03.221353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 175/351] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:03 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:03.314404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:03.315012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:03.321753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:03.322321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:03.322869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:03.324108 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:03.324560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:03.324979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:03.461097 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:03.468699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-89374fd9-17b9-4c39-b4f7-2b459544f804 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.158165 Aug 24 15:29:03.469256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 177/352] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:03 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:04.243097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:04.243097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:04.248824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:04.249315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:04.250031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:04.251207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:04.251682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:04.252292 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:04.408649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:04.417612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dbe2830e-72d9-45b6-a1ba-219a3f21240e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.179727 Aug 24 15:29:04.418521 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 176/353] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:04 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:04.492623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:04.493937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:04.511420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:04.512376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:04.512911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:04.513697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:04.514446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:04.515017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:04.697668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:04.719963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a2601ca5-0931-479a-b7f6-71d1476d41da tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.221824 Aug 24 15:29:04.722320 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 178/354] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:04 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:05.440386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:05.440994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:05.447690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:05.448175 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:05.448604 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:05.449290 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:05.449739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:05.450155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:05.613320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:05.624366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-18ecbcdb-415b-4bff-9b53-b0ba7cacad3b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.187506 Aug 24 15:29:05.625225 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 177/355] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:05 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:05.741505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:05.742204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:05.750437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:05.751110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:05.752196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:05.752432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:05.752962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:05.753641 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:05.913503 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:05.922142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-54f6729e-d693-4c51-9668-670753462876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1313 microversion: 2.1 time: 0.185182 Aug 24 15:29:05.922812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 179/356] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:05 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:06.653205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:06.653840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:06.656159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=56 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:06.661654 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:06.662179 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:06.662639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:06.663337 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:06.663792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:06.664217 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:06.801352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:06.809977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ad6ecc76-aef7-4254-88f0-e8b95ab23711 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1322 microversion: 2.1 time: 0.160754 Aug 24 15:29:06.810590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 178/357] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:06 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:06.944593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:06.945262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:06.951378 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:06.951855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:06.952282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:06.952956 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:06.953400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:06.953831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:07.089850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:07.096025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:07.098267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c5db46f1-f7ac-4600-96e1-fa1955372a09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1496 microversion: 2.1 time: 0.157685 Aug 24 15:29:07.099399 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 180/358] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:06 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:07.434250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-43adda91-b808-4728-8480-fef238d6695d req-ce6b5d75-30cd-4240-8782-fbadfe6d278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f66ab1-18d5-41d8-b752-d6a00fd893b4", "name": "network-vif-plugged", "status": "completed", "tag": "a94c617a-233e-4bf8-b514-c995148f2911"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:07.449706 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-43adda91-b808-4728-8480-fef238d6695d req-ce6b5d75-30cd-4240-8782-fbadfe6d278a service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:07.451037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-43adda91-b808-4728-8480-fef238d6695d req-ce6b5d75-30cd-4240-8782-fbadfe6d278a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:07.451558 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-43adda91-b808-4728-8480-fef238d6695d req-ce6b5d75-30cd-4240-8782-fbadfe6d278a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:07.473585 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-43adda91-b808-4728-8480-fef238d6695d req-ce6b5d75-30cd-4240-8782-fbadfe6d278a service nova] Creating event network-vif-plugged:a94c617a-233e-4bf8-b514-c995148f2911 for instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 on hv-cinder-84890 Aug 24 15:29:07.479292 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-43adda91-b808-4728-8480-fef238d6695d req-ce6b5d75-30cd-4240-8782-fbadfe6d278a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050672 Aug 24 15:29:07.479905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 179/359] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:29:07.832437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:07.833117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:07.840015 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:07.840703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:07.841146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:07.841837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:07.842308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:07.842735 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:07.865986 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:07.866917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:07.881222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:07.882928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:07.883985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:07.886054 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:07.887915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:07.888856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:07.943464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:29:08.043475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9ca06e6d-70a5-4137-8989-19af2a85c5a1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 204 len: 0 microversion: 2.1 time: 0.182123 Aug 24 15:29:08.043607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:08.044164 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 180/360] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:29:07 2022] DELETE /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:29:08.055311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:08.056669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:08.064502 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:08.065049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:08.065541 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:08.066454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:08.067107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:08.067517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a481b2d9-d5a4-4989-a824-467125361987 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1516 microversion: 2.1 time: 0.238964 Aug 24 15:29:08.067681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:08.068116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 181/361] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:07 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:08.090744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:08.093398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:08.099288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:08.099993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:08.100633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:08.101523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:08.101957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:08.102575 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:08.142267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lazy-loading 'flavor' on Instance uuid 5906ae0b-2d03-4ffb-b754-4580ba86246d {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:29:08.240431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:08.250292 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-67ed11ba-9aa2-4e9c-8066-ea45e12aa67c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.200843 Aug 24 15:29:08.251346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 181/362] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:08 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:08.277895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-dead598d-7f71-418c-a032-3f0c0c5b994a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d/action" status: 200 len: 32 microversion: 2.1 time: 0.191573 Aug 24 15:29:08.278959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 182/363] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:29:08 2022] POST /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:29:08.291794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:08.292773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:08.302109 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:08.303039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:08.306710 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:08.307742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:08.309014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:08.309461 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:08.479611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:08.488026 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8e3bda8d-570b-4fb8-9ce5-340bd111843b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.202939 Aug 24 15:29:08.488710 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 182/364] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:08 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:09.039049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dde3177f-0edf-4c03-a7e3-7973c71ceed6", "device": "/dev/sdb"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:09.042646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:09.054175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:09.054885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:09.055121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:09.055855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:09.056335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:09.056740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:09.273829 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:09.274491 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:09.281679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:09.282179 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:09.283073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:09.283803 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:09.284345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:09.284785 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:09.430534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:09.438869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-854b8c61-20a9-4389-9c35-2a20e788ab7c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.169623 Aug 24 15:29:09.439446 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 183/365] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:09 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:09.508888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:09.509495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:09.517891 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:09.518418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:09.518854 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:09.519611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:09.520062 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:09.520485 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:09.681546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:09.691419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b1e29846-e675-4d13-a279-2c074d94e509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.186266 Aug 24 15:29:09.700011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 184/366] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:09 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:10.460412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:10.461055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:10.467474 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:10.467994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:10.468424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:10.469103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:10.469552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:10.470042 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:10.605643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:10.613711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9d4ad006-b734-40c5-9b69-f0bf5b37bcfb tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.157261 Aug 24 15:29:10.614295 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 185/367] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:10 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:10.713321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:10.713939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:10.720432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:10.720919 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:10.721358 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:10.722165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:10.722648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:10.723071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:10.743175 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:10.866010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:10.874850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8572c3ae-5c5f-4dc6-88a9-630a18ec1787 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.165613 Aug 24 15:29:10.875402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 186/368] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:10 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:11.636470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:11.637112 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:11.644041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:11.644522 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:11.644951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:11.645653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:11.646107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:11.646559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:11.794198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:11.804358 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ec0b14b8-888a-42f9-afc9-b980b28623e7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.171599 Aug 24 15:29:11.804952 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 187/369] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:11 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:11.895770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:11.896381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:11.907141 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:11.907894 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:11.908334 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:11.909045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:11.909654 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:11.910430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:12.052872 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:12.060961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-70cdf134-be3b-4a8d-ade2-1a24507c9d16 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.169122 Aug 24 15:29:12.061743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 188/370] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:11 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:12.824847 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:12.825463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:12.831796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:12.832275 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:12.832705 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:12.833390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:12.833838 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:12.834280 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:12.969046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:12.976921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1fe6b656-cd8c-4315-8192-e272f08a08fd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.155892 Aug 24 15:29:12.977489 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 189/371] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:12 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:13.082165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:13.082733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:13.089355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:13.089835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:13.090311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:13.091036 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:13.091483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:13.091904 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:13.293584 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:13.302209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1822e9c4-7a1d-40a2-958b-5a69e963ae3e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.223727 Aug 24 15:29:13.303299 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 190/372] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:13 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:13.365579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6a33f36f-0cc6-41c9-8d6f-41a3c7efd8ac tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "POST /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.330812 Aug 24 15:29:13.371848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 183/373] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:29:09 2022] POST /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3/os-volume_attachments => generated 194 bytes in 4338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:29:14.000806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:14.001580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:14.009805 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:14.011011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:14.011532 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:14.012325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:14.013332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:14.013332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:14.193750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:14.202552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5f38e186-4647-4c4a-840f-844441e2bfd0 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.206097 Aug 24 15:29:14.203152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 191/374] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:13 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:14.323800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:14.324532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:14.331442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:14.331918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:14.332535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:14.333219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:14.333664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:14.334082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:14.465364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:14.473316 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e3a12be9-b9be-459b-9e72-1b6e5f59d95d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.153997 Aug 24 15:29:14.473974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 184/375] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:14 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:15.223541 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:15.224149 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:15.230461 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:15.230942 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:15.231375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:15.232064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:15.232534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:15.233006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:15.362641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:15.370766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cd681942-25f6-49d4-9ff6-7c6ad0c20117 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.150978 Aug 24 15:29:15.371315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 192/376] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:15 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:15.495254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:15.495867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:15.502528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:15.503016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:15.503450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:15.504146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:15.504596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:15.505018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:15.636401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:15.644009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b312b486-40c4-418e-b811-9164b1dc1201 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.153136 Aug 24 15:29:15.644567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 185/377] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:15 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:16.391955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:16.392544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:16.399159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:16.399648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:16.400086 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:16.401281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:16.401740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:16.402168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:16.536574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:16.544842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ca277d1f-3934-4c56-94e1-8b7f6eb094ca tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.156710 Aug 24 15:29:16.545430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 193/378] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:16 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:16.664971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:16.665592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:16.672556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:16.673043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:16.673481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:16.674246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:16.674700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:16.675125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:16.819429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:16.833371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b396d51c-ccc4-4205-81de-3968443b1e97 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.172264 Aug 24 15:29:16.834409 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 186/379] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:16 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:17.565114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:17.565717 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:17.572288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:17.572824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:17.573256 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:17.573945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:17.574429 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:17.574848 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:17.712632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:17.721787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-22c18660-5eea-4b3a-bee1-3cc9970e9c09 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.160432 Aug 24 15:29:17.722393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 194/380] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:17 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:17.855044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:17.855704 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:17.862201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:17.862702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:17.863135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:17.863813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:17.864256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:17.864688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:17.996224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:18.004159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8d63ce2b-cbf7-4605-8e39-85594c2738e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.153444 Aug 24 15:29:18.004722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 187/381] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:17 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:18.742994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:18.743601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:18.750766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:18.751244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:18.751673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:18.752361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:18.752811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:18.753234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:18.883660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:18.891236 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-611e57ba-8253-4f1b-afb0-27fef41fede8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.152085 Aug 24 15:29:18.891800 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 195/382] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:18 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:19.024863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:19.025397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:19.032170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:19.032904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:19.033334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:19.034008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:19.034492 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:19.034910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:19.167234 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:19.175498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-db623bf1-b1cd-4d70-8487-5401e10d9e5b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.154478 Aug 24 15:29:19.176075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 188/383] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:19 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:19.913003 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:19.913603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:19.922276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:19.922987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:19.923421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:19.924133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:19.924586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:19.925019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:20.195932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:20.196830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:20.209854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:20.210678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:20.212426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:20.214650 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:20.215184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:20.215617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:20.380642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:20.388478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-eea89deb-88c8-4bcc-8720-c9ada9fe0dd2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.196569 Aug 24 15:29:20.389058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 189/384] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:20 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:20.393502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-ac42d2f2-ff7c-4ecb-af58-7a983afda3c7 req-5d4f8e81-c7a8-4b36-88f1-3be22cfeb1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b39e72e-2601-4952-b79a-ee4848035902", "name": "network-vif-unplugged", "status": "completed", "tag": "096223ce-909d-40e1-8262-1a6ca6a5867a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:20.403233 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ac42d2f2-ff7c-4ecb-af58-7a983afda3c7 req-5d4f8e81-c7a8-4b36-88f1-3be22cfeb1db service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:20.403708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ac42d2f2-ff7c-4ecb-af58-7a983afda3c7 req-5d4f8e81-c7a8-4b36-88f1-3be22cfeb1db service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:20.404171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ac42d2f2-ff7c-4ecb-af58-7a983afda3c7 req-5d4f8e81-c7a8-4b36-88f1-3be22cfeb1db service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:20.415503 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-ac42d2f2-ff7c-4ecb-af58-7a983afda3c7 req-5d4f8e81-c7a8-4b36-88f1-3be22cfeb1db service nova] Creating event network-vif-unplugged:096223ce-909d-40e1-8262-1a6ca6a5867a for instance 7b39e72e-2601-4952-b79a-ee4848035902 on hv-cinder-84890 Aug 24 15:29:20.421298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-ac42d2f2-ff7c-4ecb-af58-7a983afda3c7 req-5d4f8e81-c7a8-4b36-88f1-3be22cfeb1db service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031085 Aug 24 15:29:20.422113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 190/385] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:29:20.477810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:20.486067 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-01d99ed6-9a02-4d58-af5d-970eb5efaa7a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1502 microversion: 2.1 time: 0.576753 Aug 24 15:29:20.486671 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 196/386] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:19 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1502 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:20.714322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-1cfb320d-abec-4f2b-a0c7-e8eb2f6e6cef req-a6d9ba54-e0e5-479c-a707-be93eaccc349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b39e72e-2601-4952-b79a-ee4848035902", "name": "network-vif-deleted", "tag": "096223ce-909d-40e1-8262-1a6ca6a5867a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:20.723940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1cfb320d-abec-4f2b-a0c7-e8eb2f6e6cef req-a6d9ba54-e0e5-479c-a707-be93eaccc349 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:20.724414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1cfb320d-abec-4f2b-a0c7-e8eb2f6e6cef req-a6d9ba54-e0e5-479c-a707-be93eaccc349 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:20.724843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1cfb320d-abec-4f2b-a0c7-e8eb2f6e6cef req-a6d9ba54-e0e5-479c-a707-be93eaccc349 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:20.737114 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-1cfb320d-abec-4f2b-a0c7-e8eb2f6e6cef req-a6d9ba54-e0e5-479c-a707-be93eaccc349 service nova] Creating event network-vif-deleted:096223ce-909d-40e1-8262-1a6ca6a5867a for instance 7b39e72e-2601-4952-b79a-ee4848035902 on hv-cinder-84890 Aug 24 15:29:20.741892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-1cfb320d-abec-4f2b-a0c7-e8eb2f6e6cef req-a6d9ba54-e0e5-479c-a707-be93eaccc349 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Aug 24 15:29:20.742558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 191/387] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:29:21.409911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:21.411167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:21.417929 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:21.418740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:21.419321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:21.420207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:21.420675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:21.421339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:21.512143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:21.513536 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:21.520807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:21.521783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:21.522426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:21.523463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:21.524127 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:21.524708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:21.575397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:21.576150 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:21.577536 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:21.577995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lazy-loading 'fault' on Instance uuid 7b39e72e-2601-4952-b79a-ee4848035902 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:29:21.600634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:21.609136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-831e15bd-3830-48d0-9470-4552c179a215 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.203611 Aug 24 15:29:21.614588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 197/388] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:21 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:21.633948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:21.642783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-929287f8-3630-4076-8e92-d57991507817 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1303 microversion: 2.1 time: 0.138710 Aug 24 15:29:21.643594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 192/389] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:21 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:22.629138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:22.629742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:22.636526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:22.637078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:22.637569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:22.638364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:22.638893 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:22.639377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:22.667453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:22.668302 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:22.675149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:22.675711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:22.676217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:22.676981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:22.677528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:22.678022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:22.709366 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:22.710169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:22.710734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:22.711300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lazy-loading 'fault' on Instance uuid 7b39e72e-2601-4952-b79a-ee4848035902 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:29:22.752737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:22.760334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a731c64c-9be0-48c7-b4a4-afcade5f7c53 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1303 microversion: 2.1 time: 0.097255 Aug 24 15:29:22.761150 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 193/390] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:22 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:22.774015 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:22.782207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-43ee4a2f-7793-4c21-8e99-57a056a9d9db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.156819 Aug 24 15:29:22.783052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 198/391] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:22 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:23.780917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:23.781515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:23.788055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:23.788463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:23.788886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:23.789557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:23.789999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:23.790442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:23.802987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:23.803594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:23.810568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:23.811046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:23.811472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:23.812157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:23.812606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:23.813043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:23.823138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:23.823614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:23.824037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:23.824470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lazy-loading 'fault' on Instance uuid 7b39e72e-2601-4952-b79a-ee4848035902 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:29:23.827201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:23.866102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:23.874282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-059e6656-da80-427f-9a00-bf4d326f7040 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1303 microversion: 2.1 time: 0.097090 Aug 24 15:29:23.874854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 194/392] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:23 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:23.948184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:23.956109 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-597e0ba6-ac63-49b3-9bea-3cfd4c03ec2a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.156891 Aug 24 15:29:23.960301 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 199/393] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:23 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:24.895249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:24.895761 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:24.902159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:24.902659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:24.903086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:24.903757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:24.904198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:24.904613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:24.935016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:24.935485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:24.935910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:24.936339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lazy-loading 'fault' on Instance uuid 7b39e72e-2601-4952-b79a-ee4848035902 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:29:24.980181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:24.980950 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:24.981084 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:24.987628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:24.988107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:24.988542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:24.988660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aed12477-376e-4237-aac9-d0d6ef5db104 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 200 len: 1303 microversion: 2.1 time: 0.097150 Aug 24 15:29:24.989311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 195/394] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:24 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:24.989433 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:24.989740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:24.990262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:25.128681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:25.136606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-09888ebe-0824-4be5-9ba6-3ace44b080a7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.160895 Aug 24 15:29:25.137177 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 200/395] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:24 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:26.009444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:26.010144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: 7b39e72e-2601-4952-b79a-ee4848035902] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:26.017065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:26.017535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:26.017964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:26.018674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:26.019123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:26.019590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:26.033600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] HTTP exception thrown: Instance 7b39e72e-2601-4952-b79a-ee4848035902 could not be found. Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Request method failure captured: Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 HTTP/1.1 Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkOIJbiAgoFCCBdDf4CfAJOeXtSvoF-LY--Byj94DXWh18BXAWl1LvGFsCpvfmv3mOU_Qjn1pL3glBB8vKBOVENiOvJ8mtTaYx0_PhxXf_2_q1-6oTaqx-v6w-JRtlkiCAkrn7UZS-zDz9XKhjAQ0zVwK9nl3HBrya7iD1hB48RDcx0 Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 7292443f39f548e79c3bb9d07bccb0df Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesActionsTest-743420610 Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:29:26.035247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7292443f39f548e79c3bb9d07bccb0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7292443f39f548e79c3bb9d07bccb0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7292443f39f548e79c3bb9d07bccb0df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7292443f39f548e79c3bb9d07bccb0df"}]}] Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesActionsTest-743420610 Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 7292443f39f548e79c3bb9d07bccb0df Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesActionsTest-743420610 Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesActionsTest-743420610-project Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 22ba5db8353847d7b14ba2d4cb391073 Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesActionsTest-743420610-project Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 7b39e72e-2601-4952-b79a-ee4848035902 could not be found. Aug 24 15:29:26.036794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '7b39e72e-2601-4952-b79a-ee4848035902'} Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b39e72e-2601-4952-b79a-ee4848035902 could not be found. Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:29:26.037687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b39e72e-2601-4952-b79a-ee4848035902 could not be found. Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b39e72e-2601-4952-b79a-ee4848035902 could not be found. Aug 24 15:29:26.039336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:29:26.040748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Returning 404 to user: Instance 7b39e72e-2601-4952-b79a-ee4848035902 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:29:26.040748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-454c04ac-76b9-4f8a-9d03-3451e8ff00a6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902" status: 404 len: 111 microversion: 2.1 time: 0.031032 Aug 24 15:29:26.040748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 196/396] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:26 2022] GET /compute/v2.1/servers/7b39e72e-2601-4952-b79a-ee4848035902 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:29:26.153816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1353265878", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "networks": [{"uuid": "c3a90c17-bb90-4723-9bdb-89bdcfa9e193"}]}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:26.156575 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:26.157176 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:26.163385 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:26.163865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:26.164293 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:26.164986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:26.165438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:26.165862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:26.208305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] validate_networks() for [('c3a90c17-bb90-4723-9bdb-89bdcfa9e193', None, None, None, None, None)] {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:29:26.311690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:26.321349 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4e4b6480-8e60-4b51-be4f-07cebfc2d114 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.168490 Aug 24 15:29:26.322006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 197/397] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:26 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:26.576766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:29:26.577140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:29:26.577680 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:29:26.578366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:29:26.578888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:29:26.588765 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:26.589251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:26.589683 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:26.590449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:26.590905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:26.591432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:26.608998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Getting quotas for project 7292443f39f548e79c3bb9d07bccb0df. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:29:26.612673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Getting quotas for user 22ba5db8353847d7b14ba2d4cb391073 and project 7292443f39f548e79c3bb9d07bccb0df. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:29:26.624021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:29:26.626526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:29:26.675898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2c9ee68c-330a-4f3d-8cac-6648386bb373 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525837 Aug 24 15:29:26.676958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 201/398] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:29:26.695622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1b7b30e8-5dda-4196-a1fe-d44655700cd1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:26.696231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1b7b30e8-5dda-4196-a1fe-d44655700cd1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:26.751384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1b7b30e8-5dda-4196-a1fe-d44655700cd1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:26.759159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1b7b30e8-5dda-4196-a1fe-d44655700cd1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1214 microversion: 2.1 time: 0.067377 Aug 24 15:29:26.759928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 198/399] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:26 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:27.354913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:27.355428 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:27.362003 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:27.362597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:27.362956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:27.363712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:27.364156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:27.364586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:27.493470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:27.501912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d466ab59-ba4c-408c-ab78-c4c91536d017 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.151751 Aug 24 15:29:27.502536 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 202/400] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:27 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:27.779111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:27.779791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:27.786510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:27.786985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:27.787414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:27.788089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:27.788532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:27.788946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:27.851730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:27.859716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-98fa9ba2-cf94-4d8e-8f7a-bdbd404d40e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.084439 Aug 24 15:29:27.860262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 199/401] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:27 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:28.523057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:28.523670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:28.530661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:28.531147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:28.531618 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:28.532326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:28.533043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:28.533468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:28.667110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:28.670497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:28.675476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-67bd959b-ead5-41d0-9fae-9dfb38e59660 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.156293 Aug 24 15:29:28.676036 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 203/402] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:28 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:28.880490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:28.881089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:28.888165 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:28.888639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:28.889084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:28.889744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:28.890188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:28.890635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:28.950765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:28.958284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c3534e26-827e-41cb-aa46-dfea842eec71 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.081573 Aug 24 15:29:28.962722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 200/403] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:28 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:29.696342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:29.696975 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:29.703318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:29.703786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:29.704212 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:29.704897 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:29.705342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:29.705758 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:29.836054 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:29.844057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9e30459f-f794-4f67-98f2-489793f08fd9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.151896 Aug 24 15:29:29.844606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 204/404] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:29 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:29.978622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:29.979202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:29.981500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=64 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:29.986892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:29.988566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:29.988566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:29.988566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:29.989158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:29.989587 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:30.053464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:30.061109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f794824e-f59d-4e35-8d5b-84e062952620 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.086305 Aug 24 15:29:30.061655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 201/405] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:29 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:30.864891 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:30.865509 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:30.871869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:30.872345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:30.872785 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:30.873467 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:30.873920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:30.874374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:31.005366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:31.013456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1c861bc3-af36-455d-9323-92c8a55f7b18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.152477 Aug 24 15:29:31.014016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 205/406] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:30 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:31.081742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:31.082381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:31.089933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:31.090433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:31.090862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:31.091540 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:31.091982 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:31.092396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:31.155780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:31.163783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f3f2a379-88c3-4528-84e5-8bc47966fe9d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.085928 Aug 24 15:29:31.164344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 202/407] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:31 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:32.034689 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:32.035299 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:32.041651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:32.042137 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:32.042602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:32.043298 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:32.043757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:32.044184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:32.183417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:32.183913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:32.184028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:32.190654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:32.191143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:32.191365 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b561f647-e4f4-48e7-924b-7a67764f3fe1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.160812 Aug 24 15:29:32.191574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:32.191951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 206/408] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:32 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:32.192347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:32.192932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:32.193359 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:32.253970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:32.262998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c6a68042-830d-4459-bcbe-0c76d6b371de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.083391 Aug 24 15:29:32.263570 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 203/409] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:32 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:33.212537 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:33.213215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:33.219827 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:33.220305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:33.220744 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:33.221431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:33.221883 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:33.222331 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:33.286260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:33.287507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:33.294481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:33.294961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:33.295392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:33.296078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:33.296528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:33.296948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:33.364501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:33.364741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:33.372281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1bba5340-83e7-4d99-9b70-54b08808eff7 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.090109 Aug 24 15:29:33.372507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a8a493ee-f624-4666-ac00-b78cd7713c6a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.163801 Aug 24 15:29:33.373209 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 204/410] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:33 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:33.373343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 207/411] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:33 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:34.393087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:34.393671 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:34.394028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:34.394114 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:34.400133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:34.400310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:34.400606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:34.400732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:34.401040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:34.401171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:34.401729 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:34.401841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:34.402178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:34.402318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:34.402627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:34.402724 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:34.468938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:34.476691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bdaebe05-4fd0-4c88-9ec4-ea05931edc37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.087463 Aug 24 15:29:34.477253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 205/412] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:34 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:34.539702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:34.548389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e3ac006d-598d-4388-8c55-7efc5bba3668 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.159186 Aug 24 15:29:34.548976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 208/413] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:34 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:35.497213 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:35.497825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:35.504563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:35.505042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:35.505483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:35.506171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:35.506928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:35.507354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:35.569373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:35.569987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:35.570327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:35.576233 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:35.576715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:35.577151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:35.577960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:35.578446 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:35.578869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:35.583373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bb276031-b917-4b5a-8d6f-fcfb11cf0b83 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1218 microversion: 2.1 time: 0.090178 Aug 24 15:29:35.584267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 206/414] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:35 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:35.716828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:35.724493 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-baef4f1d-5ba0-4239-a775-db6ea9cac5cc tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.159192 Aug 24 15:29:35.725050 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 209/415] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:35 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:36.604603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:36.605210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:36.611742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:36.612224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:36.612659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:36.613348 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:36.613803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:36.614244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:36.676578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:36.684767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5802f9c4-669b-4bf7-a8f0-f75d8b81cdad tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1210 microversion: 2.1 time: 0.084014 Aug 24 15:29:36.685326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 207/416] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:36 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:36.745633 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:36.746316 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:36.748515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:36.749165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:36.750057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:36.756606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:36.757079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:36.757517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:36.758213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:36.758697 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:36.759123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:36.898994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:36.910170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-17c20836-2e00-4ade-999d-b43040044d2b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.168943 Aug 24 15:29:36.910781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 210/417] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:36 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:37.707412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:37.707948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:37.709814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:37.716388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:37.716871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:37.717307 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:37.717999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:37.718562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:37.718991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:37.787326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:37.801896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0d1e1359-ceed-41e1-9922-fc073eba36a4 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1266 microversion: 2.1 time: 0.098066 Aug 24 15:29:37.803593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 208/418] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:37 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:37.944274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:37.945886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:37.958591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:37.959330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:37.960470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:37.961795 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:37.962980 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:37.963989 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:38.204607 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:38.220021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c2ebd26c-beb3-40bb-b16a-672f10e1ae64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.284507 Aug 24 15:29:38.230252 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 211/419] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:37 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:38.827124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:38.828418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:38.835073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:38.835831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:38.836259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:38.837139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:38.837748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:38.838551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:38.910529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:38.919110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ac5c1622-784a-4e89-be73-0fcd698bc6fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1272 microversion: 2.1 time: 0.097678 Aug 24 15:29:38.919778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 209/420] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:38 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:39.243731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:39.245060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:39.252418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:39.252905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:39.253341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:39.254051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:39.254578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:39.255364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:39.411743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:39.419852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5ffc8868-72b9-4102-8a7d-2f01c8d8e3ce tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.180393 Aug 24 15:29:39.420423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 212/421] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:39 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:39.940697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:39.941343 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:39.947524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:39.947906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:39.948341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:39.949031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:39.949483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:39.949909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:40.085897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:40.094022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5e6bc398-2da4-4a44-bec5-571afff31005 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.157101 Aug 24 15:29:40.094610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 210/422] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:39 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:40.441407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:40.442174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:40.450746 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:40.451241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:40.451692 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:40.452412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:40.452864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:40.453300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:40.609775 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:40.620647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e5054cc3-511f-47a3-ba51-242479357261 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.183542 Aug 24 15:29:40.621753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 213/423] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:40 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:41.116300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:41.117595 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:41.127019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:41.127844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:41.128358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:41.129120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:41.129819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:41.130630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:41.283779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:41.291445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d6c742e4-9abf-4e6c-930b-d88da44b4582 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.178322 Aug 24 15:29:41.292064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 211/424] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:41 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:41.643502 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:41.644899 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:41.652266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:41.652751 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:41.653188 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:41.653888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:41.654404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:41.654884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:42.199599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:42.209807 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7b36b4a9-8339-49f4-bbc4-63a90fa5b8d7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.570617 Aug 24 15:29:42.224403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 214/425] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:41 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:42.312350 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:42.312971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:42.326754 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:42.327241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:42.327865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:42.328748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:42.329208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:42.329635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:42.346268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:42.490453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:42.499576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cfe9bd8a-7c8d-414f-96fd-ecb2ee9873ee tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.190840 Aug 24 15:29:42.500443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 212/426] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:42 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:43.232608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:43.233893 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:43.241985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:43.242914 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:43.243651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:43.245906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:43.246648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:43.247343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:43.521979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:43.524004 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:43.540728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:43.541605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:43.542279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:43.543249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:43.544099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:43.544740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:43.629670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:43.643350 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4c1d7b07-b6af-490f-a4b9-2f3c0b4c0ce8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.415162 Aug 24 15:29:43.646488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 215/427] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:43 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:43.727558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:43.740162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a74f5843-bf53-409a-860a-4ef3aba9c281 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.222759 Aug 24 15:29:43.741149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 213/428] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:43 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:44.426802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-4682590b-641e-4a1d-953d-8f66cf6dbd68 req-f781ce53-1daf-4c04-a62d-f86e1f0fb6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c89b2a7d-94fc-4c71-b695-8576be4e9a01", "tag": "e3306819-1a9c-4955-af00-8d58acc2ff45"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:29:44.458914 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4682590b-641e-4a1d-953d-8f66cf6dbd68 req-f781ce53-1daf-4c04-a62d-f86e1f0fb6eb service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:44.462472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4682590b-641e-4a1d-953d-8f66cf6dbd68 req-f781ce53-1daf-4c04-a62d-f86e1f0fb6eb service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:44.463287 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4682590b-641e-4a1d-953d-8f66cf6dbd68 req-f781ce53-1daf-4c04-a62d-f86e1f0fb6eb service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:44.489466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-4682590b-641e-4a1d-953d-8f66cf6dbd68 req-f781ce53-1daf-4c04-a62d-f86e1f0fb6eb service nova] Creating event network-changed:e3306819-1a9c-4955-af00-8d58acc2ff45 for instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 on hv-cinder-84890 Aug 24 15:29:44.498040 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-4682590b-641e-4a1d-953d-8f66cf6dbd68 req-f781ce53-1daf-4c04-a62d-f86e1f0fb6eb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075896 Aug 24 15:29:44.499383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 216/429] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:29:44.672228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:44.672739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:44.682883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:44.683405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:44.683821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:44.684555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:44.685487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:44.685487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:44.763267 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:44.764432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:44.771812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:44.772352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:44.772863 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:44.773680 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:44.774248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:44.779102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:44.880471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:44.890110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1b5d0ee1-121b-476b-9933-5f67dd23fbda tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.221617 Aug 24 15:29:44.891484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 214/430] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:44 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:45.411786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:45.420836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1e2442a4-d740-4d22-a537-4e0eef74afdd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.663032 Aug 24 15:29:45.421424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 217/431] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:44 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:45.916830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:45.917840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:45.925696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:45.926458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:45.927162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:45.928486 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:45.929174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:45.929962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:46.097115 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:46.106995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9ecd94f0-1118-4366-be99-d2a86fbae744 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.194305 Aug 24 15:29:46.107889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 215/432] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:45 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:46.442116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:46.442747 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:46.450107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:46.450644 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:46.451073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:46.455142 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:46.455771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:46.456357 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:46.642630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:46.652386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3ae2d27e-2167-4c22-81a8-eccdf3ecbb61 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.214478 Aug 24 15:29:46.653423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 218/433] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:46 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:47.128667 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:47.129275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:47.136468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:47.137189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:47.137781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:47.138752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:47.139409 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:47.140002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:47.593606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:47.605032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d18c1326-3e11-4137-a276-96fcb9663dcb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.480121 Aug 24 15:29:47.606997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 216/434] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:47 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:47.674511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:47.675865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:47.687124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:47.688484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:47.688722 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:47.689802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:47.691655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:47.692885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:47.950687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:47.961114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e1da91ca-8c3e-4901-a6e0-bc16790a19cc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.290878 Aug 24 15:29:47.964123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 219/435] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:47 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:48.629894 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:48.631162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:48.638800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:48.639321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:48.639779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:48.640687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:48.641138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:48.641557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:48.921864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:48.930334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c02c59cc-e7f7-4881-88a9-74a25ad5a9cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.306588 Aug 24 15:29:48.932032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 217/436] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:48 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:48.983865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:48.984516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:49.006105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:49.006658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:49.007101 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:49.007828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:49.008286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:49.008713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:49.193206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:49.202113 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b28c704a-930b-456e-b49a-5810f338e3fc tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.222019 Aug 24 15:29:49.203002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 220/437] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:48 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:49.957993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:49.959864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:49.973850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:49.974998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:49.976223 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:49.979007 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:49.987848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:49.988883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:50.232265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:50.233807 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:50.243005 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:50.243918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:50.245349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:50.246357 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:50.246993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:50.247284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:50.248116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:50.253865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:29:50.261847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bebfe473-d70a-4821-b228-f9e5a134ede6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.311873 Aug 24 15:29:50.263096 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 218/438] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:49 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:50.424020 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:50.433908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-48aae5f5-0721-47c3-be71-8db1d8f372c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.211850 Aug 24 15:29:50.434985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 221/439] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:50 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:51.285334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:51.285940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:51.292730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:51.293218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:51.293716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:51.294452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:51.295080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:51.295719 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:51.455988 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:51.456735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:51.465020 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:51.469231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:51.470933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:51.471762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:51.472308 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:51.473959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:51.632020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:51.642045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b1f03f8f-4d98-4a8a-a021-925222d705fa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.360217 Aug 24 15:29:51.645334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 219/440] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:51 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:51.670421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:51.678886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d73ac16a-c904-46dc-8f06-1f43e32255cd tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.227214 Aug 24 15:29:51.680121 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 222/441] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:51 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:52.664919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:52.666210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:52.675300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:52.675783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:52.676241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:52.676931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:52.677373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:52.677796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:52.699679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:52.700323 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:52.708826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:52.709547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:52.710198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:52.711284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:52.711822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:52.712345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:52.868477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:52.879415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1bd5c844-15eb-44da-96b4-30271df4d2cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.218344 Aug 24 15:29:52.879992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 220/442] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:52 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:52.902879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:52.914188 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-79718563-657e-4c5c-974e-00d2ca1e2613 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.218533 Aug 24 15:29:52.915938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 223/443] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:52 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:53.900021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:53.901140 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:53.908310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:53.908845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:53.909231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:53.909879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:53.910636 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:53.911222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:53.942844 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:53.944456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:53.952512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:53.953038 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:53.953561 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:53.954355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:53.954990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:53.956168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:54.099460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:54.108195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cb18c0f6-108a-486c-ab67-a9cd03867d9d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.212010 Aug 24 15:29:54.108778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 221/444] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:53 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:54.168685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:54.178075 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fe31a070-16a8-4d0d-8460-eea5b55215d2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.245926 Aug 24 15:29:54.180623 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 224/445] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:53 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:54.213675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:29:54.213922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:29:55.131574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:55.132169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:55.145632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:55.146117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:55.146595 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:55.147288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:55.147736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:55.148156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:55.213516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:55.214945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:55.223301 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:55.223933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:55.224632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:55.225603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:55.226407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:55.227072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:55.315192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:55.325435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-78668547-2068-4983-84f6-2edde8f854ad tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.196219 Aug 24 15:29:55.326341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 222/446] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:55 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:55.451688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:55.469426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-70122f5e-1795-4716-9aa6-b442a674762c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.259794 Aug 24 15:29:55.470962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 225/447] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:55 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:56.351392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:56.352288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:56.359750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:56.360325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:56.360992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:56.361954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:56.362514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:56.363163 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:56.495227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:56.496650 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:56.520110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:56.520870 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:56.521549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:56.529508 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:56.530428 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:56.531091 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:56.586435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:56.598760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0efbd6dc-a81c-4a4c-83d7-780deb15d591 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.254328 Aug 24 15:29:56.599993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 223/448] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:56 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:29:56.723494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:56.740973 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6438310e-e275-4654-80cc-3e6f08a11355 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.251243 Aug 24 15:29:56.742343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 226/449] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:56 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:57.636403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:57.637165 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:57.646888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:57.647395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:57.647831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:57.648545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:57.648998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:57.649965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:57.764484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:57.765088 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:57.788975 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:57.791008 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:57.791756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:57.795254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:57.795976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:57.796977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:57.942663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:57.952600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-925abb14-7112-4aa7-8946-73218085dc96 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.322912 Aug 24 15:29:57.958491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 224/450] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:57 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:58.058068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:58.068503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bd481503-b9a6-46f4-a48d-47a41c5498e6 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.307705 Aug 24 15:29:58.069683 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 227/451] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:57 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:58.985965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:58.988132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:59.003520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:59.005146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:59.006165 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:59.007238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:59.007907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:59.008542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:59.089876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:29:59.090757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:29:59.101314 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:59.106253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:59.106923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:59.107849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:29:59.108402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:29:59.108924 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:29:59.254648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:59.265027 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2449af7e-f75f-467b-be26-7b0b2fad2583 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.285609 Aug 24 15:29:59.279090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 225/452] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:58 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:29:59.444537 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:29:59.454099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8dc1a4cf-1d11-45a1-b73c-fdf7631a9c9e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.367211 Aug 24 15:29:59.454590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 228/453] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:29:59 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:00.289471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:00.294517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:00.296861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=50 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:00.302938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:00.303707 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:00.304623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:00.305332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:00.306552 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:00.307199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:00.474260 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:00.474860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:00.484284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:00.488030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:00.488534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:00.489163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:00.492473 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:00.494390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:00.495035 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:00.503077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9dd8eea6-2547-44c9-b48d-c28892734785 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1522 microversion: 2.1 time: 0.217726 Aug 24 15:30:00.503356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 226/454] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:00 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:00.818139 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:00.828412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-38689478-56ae-49ad-9b56-a50de3f617c3 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.358009 Aug 24 15:30:00.828979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 229/455] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:00 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:01.025388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:01.025796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:01.035652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.036440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.036884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.037605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.038063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.038509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.214103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lazy-loading 'services' on Instance uuid d102fd3a-a604-4ee9-a585-64564a60a2c3 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:30:01.373370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-af300cef-ab8d-4c76-a6b6-902e9ab26479 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3/os-volume_attachments/dde3177f-0edf-4c03-a7e3-7973c71ceed6" status: 202 len: 0 microversion: 2.1 time: 0.351896 Aug 24 15:30:01.378131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 227/456] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:30:01 2022] DELETE /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3/os-volume_attachments/dde3177f-0edf-4c03-a7e3-7973c71ceed6 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:30:01.538468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:01.539223 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:01.564004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.567049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.567679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.568514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.578256 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.578842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.766147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:01.778857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b56e5f31-8ac8-4b2d-9236-b549a511684e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1502 microversion: 2.1 time: 0.247014 Aug 24 15:30:01.779804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 230/457] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:01 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:01.806277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:01.806277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:01.823050 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.823604 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.824053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.828533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.829810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.830936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.857958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:01.859100 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:01.865744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:01.868274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.875046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.875494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:01.876239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:01.876701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:01.877122 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:02.121470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:02.138146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-421c38ed-8d09-4404-9886-7611be93feef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1517 microversion: 2.1 time: 0.338431 Aug 24 15:30:02.141925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 228/458] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:01 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:02.254425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:02.273384 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-eb443244-aa1f-467e-8354-8d61f438734d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.416978 Aug 24 15:30:02.288649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 231/459] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:01 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:02.561984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b412b96f-e886-4e09-a5f3-825febd0f19f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Action: 'create', calling method: .version_select at 0x7f6659ce3040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-491574104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjxSleWAv/RCGBGEtLDowFrNn2p2CNkSVMQhbIR6+yEJ3aadXIMfbM1pDjg90yCT5aTXppOfR5eBp/tFxoKc/pBo78pEC/vc7Ht4gdovoPHL/V8pXyjxPJAIA3BTqvpgw=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:02.583987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-b412b96f-e886-4e09-a5f3-825febd0f19f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Getting quotas for project 60386a4f71754e4396434dfa34c55b75. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:30:02.588561 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-b412b96f-e886-4e09-a5f3-825febd0f19f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Getting quotas for user 24396d51e9d243f7920f9fc309d66115 and project 60386a4f71754e4396434dfa34c55b75. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:30:02.641678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b412b96f-e886-4e09-a5f3-825febd0f19f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.083845 Aug 24 15:30:02.646275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 229/460] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:30:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:30:02.761613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1206855792", "imageRef": "c41be2c1-8faf-461f-8eb2-7cb9f80c32cb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-491574104", "networks": [{"uuid": "f3771fe8-2439-48f2-a1b2-2464ea6184f4"}]}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:02.814149 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] validate_networks() for [('f3771fe8-2439-48f2-a1b2-2464ea6184f4', None, None, None, None, None)] {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:30:03.189095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:30:03.189514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:30:03.190115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:30:03.190546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:30:03.190953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:30:03.202172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.202742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.203226 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.204029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.204538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.204925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.222549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Getting quotas for project 60386a4f71754e4396434dfa34c55b75. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:30:03.226570 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Getting quotas for user 24396d51e9d243f7920f9fc309d66115 and project 60386a4f71754e4396434dfa34c55b75. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:30:03.238184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:30:03.240546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c41be2c1-8faf-461f-8eb2-7cb9f80c32cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:30:03.287403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a9eddef9-7cf2-401f-8e90-95068223b8e3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530433 Aug 24 15:30:03.289558 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 232/461] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:30:03.296764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:03.297383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:03.299240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-43e98e5d-2778-4e14-bab2-eeeb039e8121 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:03.299852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-43e98e5d-2778-4e14-bab2-eeeb039e8121 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:03.306546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.307646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.308556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.309755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.310651 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.311354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.359002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-43e98e5d-2778-4e14-bab2-eeeb039e8121 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:03.366470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-43e98e5d-2778-4e14-bab2-eeeb039e8121 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1258 microversion: 2.1 time: 0.070991 Aug 24 15:30:03.378241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 233/462] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:03 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:03.378241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-5869f5d4-d983-4382-a8d2-615b0977b6f6 req-8a06303f-4f43-46f1-87ee-e5aff522933d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89b2a7d-94fc-4c71-b695-8576be4e9a01", "name": "network-vif-plugged", "status": "completed", "tag": "e3306819-1a9c-4955-af00-8d58acc2ff45"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:03.382278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5869f5d4-d983-4382-a8d2-615b0977b6f6 req-8a06303f-4f43-46f1-87ee-e5aff522933d service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.382885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5869f5d4-d983-4382-a8d2-615b0977b6f6 req-8a06303f-4f43-46f1-87ee-e5aff522933d service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.383423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5869f5d4-d983-4382-a8d2-615b0977b6f6 req-8a06303f-4f43-46f1-87ee-e5aff522933d service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.395912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-5869f5d4-d983-4382-a8d2-615b0977b6f6 req-8a06303f-4f43-46f1-87ee-e5aff522933d service nova] Creating event network-vif-plugged:e3306819-1a9c-4955-af00-8d58acc2ff45 for instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 on hv-cinder-84890 Aug 24 15:30:03.402845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-5869f5d4-d983-4382-a8d2-615b0977b6f6 req-8a06303f-4f43-46f1-87ee-e5aff522933d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034170 Aug 24 15:30:03.403539 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 234/463] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:03.503418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:03.511817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2a36977f-daa3-4652-b6c7-de35db082b23 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.219734 Aug 24 15:30:03.512469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 230/464] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:03 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:03.735748 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:03.738391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:03.745828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.746257 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.746725 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.747534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.748030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.748608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.775716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lazy-loading 'flavor' on Instance uuid e9f66ab1-18d5-41d8-b752-d6a00fd893b4 {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:30:03.883852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8f1ba660-73d6-440c-a381-0fe610a6abc0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/action" status: 200 len: 32 microversion: 2.1 time: 0.152857 Aug 24 15:30:03.884445 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 235/465] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:30:03 2022] POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:30:03.894184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:03.894823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:03.901195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.901679 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.902114 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:03.902840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:03.903339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:03.904142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:04.037377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:04.045535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0d66d030-7ff6-4aee-b206-181f4047d72f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.155146 Aug 24 15:30:04.046135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 231/466] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:03 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:04.389601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:04.390207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:04.396337 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:04.396822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:04.397258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:04.397954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:04.398441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:04.398869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:04.464033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:04.473304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a066c9d8-9c47-4445-8bed-24eae7f9037e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1262 microversion: 2.1 time: 0.088092 Aug 24 15:30:04.473861 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 236/467] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:04 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:04.532772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:04.533805 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:04.539807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:04.540296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:04.540730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:04.541415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:04.541869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:04.542324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:04.671705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:04.679203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6b130799-97e7-4e77-819d-4721ec8cbaa2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.150355 Aug 24 15:30:04.679754 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 232/468] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:04 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:05.067286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:05.067812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:05.074808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:05.075324 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:05.075731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:05.076423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:05.077169 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:05.077599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:05.210582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:05.218474 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f91099ee-e7ff-4330-a884-0df1aa056c59 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.155096 Aug 24 15:30:05.219045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 237/469] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:05 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:05.493563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:05.494201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:05.501113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:05.501594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:05.502030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:05.502766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:05.503216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:05.503634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:05.566666 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:05.574944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5ff95d27-a2fb-4bb1-b222-202570d5ad6d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1262 microversion: 2.1 time: 0.085255 Aug 24 15:30:05.575511 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 233/470] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:05 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:05.700236 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:05.701154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:05.706944 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:05.707425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:05.707863 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:05.708557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:05.709017 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:05.709439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:05.713547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:05.843272 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:05.851460 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-aaf89920-1e68-4f1e-b2c4-6efe3ef0325a tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.155617 Aug 24 15:30:05.852025 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 238/471] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:05 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:06.239697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:06.240305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:06.246196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:06.246708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:06.247144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:06.247821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:06.248269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:06.248690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:06.375731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:06.383450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9c6e916f-872a-4e58-95f8-7355a8205e9e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.147559 Aug 24 15:30:06.384547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 234/472] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:06 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:06.596031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:06.596639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:06.603002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:06.603478 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:06.603909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:06.604590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:06.605040 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:06.605460 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:06.671400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:06.679097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6237d676-e5c7-4114-b0d9-cddbc059f0f8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1262 microversion: 2.1 time: 0.087138 Aug 24 15:30:06.679651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 239/473] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:06 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:06.872848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:06.873427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:06.879963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:06.880452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:06.880889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:06.881582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:06.882038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:06.882490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:07.013873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:07.021399 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-914b3d80-a58b-4a49-a085-6cbce8c18876 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.153103 Aug 24 15:30:07.021964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 235/474] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:06 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:07.405579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:07.406535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:07.409228 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:07.415864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:07.416687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:07.417304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:07.418021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:07.418507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:07.418933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:07.597428 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:07.605218 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-510e2c76-4b9e-4ec6-a03e-837efcbf0432 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.203665 Aug 24 15:30:07.605769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 240/475] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:07 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:07.700389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:07.701110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:07.707465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:07.708025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:07.708554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:07.709329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:07.709855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:07.710384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:07.774896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:07.783340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c2233fdf-6103-4e78-80e7-97b79a5a964b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1310 microversion: 2.1 time: 0.086977 Aug 24 15:30:07.783948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 236/476] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:07 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:07.982052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:07.982574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:07.988411 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:07.988885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:07.989313 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:07.989991 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:07.990465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:07.990883 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.015215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:30:08.059930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:08.062681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:08.069774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.070324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.070840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.072370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.072836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.073260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.105048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-40dd7cc6-f1cc-4b98-b37f-a97a67980a55 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 204 len: 0 microversion: 2.1 time: 0.125273 Aug 24 15:30:08.109499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 241/477] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:30:07 2022] DELETE /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:30:08.120296 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:08.121242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:08.128379 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.128873 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.129312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.130025 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.131144 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.131666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.227640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:08.239951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-58f84be3-e678-48ba-b88f-d4e5c6b72059 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.184417 Aug 24 15:30:08.241063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 237/478] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:08 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:08.288739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:08.298821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b613c018-0c15-4d1f-bb32-2f3216b24ef4 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1514 microversion: 2.1 time: 0.187601 Aug 24 15:30:08.299476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 242/479] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:08 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:08.624881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:08.625485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:08.631466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.631940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.632369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.633048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.633564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.633988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.762044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:08.769766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bd4fe017-b116-48bc-a4b3-b31170001064 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.148785 Aug 24 15:30:08.770413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 238/480] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:08 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:08.803933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:08.804476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:08.815329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.815812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.816247 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.816939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:08.817391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:08.817815 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:08.878477 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:08.886929 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-04b375f5-9311-4a2b-9417-c8b53fa346a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1318 microversion: 2.1 time: 0.086828 Aug 24 15:30:08.887486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 243/481] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:08 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:09.261180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:09.261777 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:09.267631 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.268103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.268533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.269205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.269648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.270062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.320507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:09.321123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:09.327126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.327622 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.328060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.328761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.329252 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.329708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.399959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:09.409301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9a67f2d1-12a1-4df4-ba72-15938d73b08c tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.152055 Aug 24 15:30:09.410093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 239/482] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:09 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:09.467251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:09.475238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a35d353f-e241-433d-83ec-b477dc254822 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1514 microversion: 2.1 time: 0.158665 Aug 24 15:30:09.475799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 244/483] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:09 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:09.791060 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:09.791691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:09.797599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.798070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.798532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.799203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.799646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.800060 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.908169 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:09.908786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:09.915959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.916444 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.916882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.917592 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:09.918049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:09.918518 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:09.931370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:09.939878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8673dfa4-2550-4b05-90b3-a037771f9b7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.153212 Aug 24 15:30:09.940446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 240/484] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:09 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:09.982122 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:09.989865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-27ae05f3-7b22-4012-b529-778e9d530b15 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1318 microversion: 2.1 time: 0.086215 Aug 24 15:30:09.990458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 245/485] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:09 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1318 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:10.432014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:10.432875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:10.439685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:10.440444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:10.441036 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:10.441732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:10.442184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:10.442760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:10.496133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:10.496947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:10.503939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:10.504424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:10.504856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:10.506379 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:10.506835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:10.507926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:10.717589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:10.726391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-dfeab337-8f0d-4480-956a-2240442cb942 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1314 microversion: 2.1 time: 0.299119 Aug 24 15:30:10.740051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 241/486] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:10 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:10.824632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:10.835634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a1bf598e-2d2c-4ada-b856-fd4cfe8885f1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1514 microversion: 2.1 time: 0.343246 Aug 24 15:30:10.836949 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 246/487] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:10 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:10.961327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:10.962859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:10.969858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:10.970384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:10.970816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:10.971509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:10.971962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:10.972380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:11.015664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:11.016498 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:11.024254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:11.024254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:11.024649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:11.025488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:11.026039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:11.026545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:11.366392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:11.379475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-91931d99-f47f-427d-94f5-9b85309b95cd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1316 microversion: 2.1 time: 0.370464 Aug 24 15:30:11.380066 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 247/488] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:11 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:11.642493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:11.662076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8d4c4215-8e43-4b01-926e-b8e25a0292cd tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.703170 Aug 24 15:30:11.663104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 242/489] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:10 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:11.750489 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:11.751101 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:11.759895 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:11.760455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:11.765170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:11.769450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:11.769450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:11.769450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:11.862254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:11.867600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:11.880885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:11.881778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:11.882426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:11.883697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:11.885960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:11.886742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.018309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:12.031244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b881b5f5-6708-4f9e-8342-71fa46fbd574 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.178486 Aug 24 15:30:12.045310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 243/490] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:11 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:12.049270 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:12.065205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-db6c5cf5-1cfe-4d9a-bf4f-98b141c2a930 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1498 microversion: 2.1 time: 0.318896 Aug 24 15:30:12.080505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 248/491] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:11 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:12.137252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-098f9b42-3184-450e-b04d-88313d492ce2 req-1bcb0b49-462d-411a-890f-f06cc620cfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d102fd3a-a604-4ee9-a585-64564a60a2c3", "name": "network-vif-deleted", "tag": "82bca62b-0802-4d60-8002-d5fe93d1d6b8"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:12.152310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-098f9b42-3184-450e-b04d-88313d492ce2 req-1bcb0b49-462d-411a-890f-f06cc620cfba service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.152816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-098f9b42-3184-450e-b04d-88313d492ce2 req-1bcb0b49-462d-411a-890f-f06cc620cfba service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.153239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-098f9b42-3184-450e-b04d-88313d492ce2 req-1bcb0b49-462d-411a-890f-f06cc620cfba service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.167125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-098f9b42-3184-450e-b04d-88313d492ce2 req-1bcb0b49-462d-411a-890f-f06cc620cfba service nova] Creating event network-vif-deleted:82bca62b-0802-4d60-8002-d5fe93d1d6b8 for instance d102fd3a-a604-4ee9-a585-64564a60a2c3 on hv-cinder-84890 Aug 24 15:30:12.172853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-098f9b42-3184-450e-b04d-88313d492ce2 req-1bcb0b49-462d-411a-890f-f06cc620cfba service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137042 Aug 24 15:30:12.173616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 244/492] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:12.401669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:12.402671 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:12.411241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.415911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.417028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.417946 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.418592 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.419410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.568213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:12.577284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6773f9cd-7567-48b5-823b-bb8df1284887 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.180446 Aug 24 15:30:12.578120 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 249/493] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:12 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:12.636225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:12.640915 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:12.641694 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:12.649534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.650190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.650690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.651703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.652442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.653036 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.678612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:30:12.685685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:12.686363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:12.694248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.694248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.694248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.694636 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.694756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.695166 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.714480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:12.772329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7a341702-d3e9-4012-9f78-dde53fa368fe tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 204 len: 0 microversion: 2.1 time: 0.137211 Aug 24 15:30:12.773606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 245/494] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:30:12 2022] DELETE /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:30:12.783185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:12.784388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:12.792235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.792814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.793261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.793968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:12.794507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:12.795246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:12.875745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:12.883824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-542a5704-2f31-4cd4-a773-874603d6d83b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.201890 Aug 24 15:30:12.894110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 250/495] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:12 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:12.984713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:12.996963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f6c8ca33-bbc7-44a0-bcfb-519f187fe4de tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.215939 Aug 24 15:30:12.997721 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 246/496] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:12 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:13.055858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:13.056385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:13.064163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:13.064889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:13.065499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:13.066407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:13.067027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:13.067637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:13.181786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:13.194427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-af10798c-939c-49b0-bfb1-0f306b92c903 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.144849 Aug 24 15:30:13.205201 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 251/497] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:13 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:13.602767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:13.603381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:13.610803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:13.612092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:13.613026 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:13.623786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:13.626299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:13.626926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:13.817790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:13.827118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-67af5e1b-b215-453c-b78b-5a7b0865d227 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.228823 Aug 24 15:30:13.829353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 247/498] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:13 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:13.906173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:13.906948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:13.909154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:13.909837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=8 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:13.922143 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:13.922789 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:13.923231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:13.923947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:13.924397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:13.924812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:14.030309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:14.031686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:14.043352 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:14.046180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:14.049394 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:14.052443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:14.055644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:14.057820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:14.177548 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:14.189957 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2749877a-bd68-4c27-907e-983dcf9a4509 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.284105 Aug 24 15:30:14.190649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 252/499] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:13 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:14.221742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:14.225135 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:14.250238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:14.250764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:14.251170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:14.252144 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:14.253045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:14.253620 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:14.268715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:14.274723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:14.282837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4e83ae25-6850-44ae-b2d1-55bd7b84a765 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.266220 Aug 24 15:30:14.283736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 248/500] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:14 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:14.358182 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:14.378508 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6e1dbbfb-24e4-408b-a0c9-979ea554c052 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.164853 Aug 24 15:30:14.379756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 253/501] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:14 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:14.854429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:14.855001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:14.861377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:14.861867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:14.862331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:14.863032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:14.863666 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:14.864095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.007197 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:15.015856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a2c9c3c2-8e82-4e4f-805a-c6502d9928f7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.165928 Aug 24 15:30:15.016533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 249/502] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:14 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:15.210150 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:15.210911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:15.223364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:15.224033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:15.224644 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.225488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:15.226053 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:15.226615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.304465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:15.305111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:15.311437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:15.311929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:15.312401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.313103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:15.313556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:15.313977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.387936 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:15.396296 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1fb23d48-a7a4-4561-a169-67aac140d41a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.190451 Aug 24 15:30:15.397021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 254/503] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:15 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:15.417802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:15.418620 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:15.424837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:15.425447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:15.426001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.426920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:15.427468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:15.427967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:15.469530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:15.479989 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-99b7e18e-46ee-4276-9542-347d2071be7e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.179316 Aug 24 15:30:15.480976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 250/504] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:15 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:15.502123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:15.510023 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b1e30796-6a94-4de9-81c7-a3f50c6e4757 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.097090 Aug 24 15:30:15.510615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 255/505] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:15 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:16.037135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:16.037879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:16.045338 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.045881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.046451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.047158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.047697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.048125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.181927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:16.191427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9674e72b-731f-4c92-8f07-4f6053f429a4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.158341 Aug 24 15:30:16.192004 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 251/506] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:16 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:16.419286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:16.419881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:16.426403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.426880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.427305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.427993 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.428437 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.428925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.503306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:16.505303 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:16.513960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.514490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.514919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.515885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.516069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.516472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.578315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:16.597693 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5b4df053-96c3-46f7-9138-6f2438030100 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.182655 Aug 24 15:30:16.598614 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 256/507] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:16 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:16.603461 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:16.604143 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:16.610577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.611384 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.612039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.613118 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:16.613810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:16.614632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:16.688953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:16.698326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-16f18f6d-c9cf-4c17-8091-49f4feb4f422 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.098214 Aug 24 15:30:16.715031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 257/508] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:16 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:16.734297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:16.742705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7958caf1-9baf-47fa-a28e-7a04a7956c0d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.243393 Aug 24 15:30:16.743477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 252/509] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:16 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:17.213330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:17.213943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:17.220101 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.220578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.221010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.221693 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.222174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.222631 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.363484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:17.375163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2c3d7560-8574-42be-a81b-4280e20f3a27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.165495 Aug 24 15:30:17.376193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 258/510] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:17 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:17.619607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:17.620319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:17.627986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.628505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.628937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.629630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.630090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.630539 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.722770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:17.723612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:17.731378 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.731864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.732297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.732998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.733452 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.733872 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.785703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:17.795404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a362666f-f5d4-481f-a5d2-d8978a2e23da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.179624 Aug 24 15:30:17.807113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 253/511] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:17 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:17.809886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:17.812476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:17.813095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:17.818880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-064a5d67-33c2-41c5-93b4-f3296cc6a31d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.099796 Aug 24 15:30:17.822262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 259/512] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:17 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:17.823582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.824247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.824682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.825415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:17.825860 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:17.826311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:17.974407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:17.983318 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-88e78ab4-025b-4901-afbf-a5c5929102c5 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.175003 Aug 24 15:30:17.983897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 254/513] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:17 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:18.396135 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:18.396737 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:18.406251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:18.406626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:18.407062 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:18.408158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:18.408701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:18.409239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:18.553900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:18.563306 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-38efe5bc-ff78-470c-beb4-dc5c2ef95f9a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.170852 Aug 24 15:30:18.564354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 260/514] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:18 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:18.816979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:18.817739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:18.825150 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:18.825696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:18.826185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:18.827002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:18.827533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:18.828047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:18.840916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:18.841503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:18.848968 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:18.849527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:18.850029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:18.850825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:18.851350 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:18.852353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:18.933437 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:18.943286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2063f99d-f63c-44bd-a67c-03f4ef1610d2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.106220 Aug 24 15:30:18.944399 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 261/515] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:18 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:18.970871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:18.980367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-30231dfb-1313-4192-aa93-0fedb74dc6e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.167281 Aug 24 15:30:18.980949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 255/516] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:18 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:19.004945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:19.005652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:19.012201 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:19.012698 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:19.013136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:19.013842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:19.014335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:19.014763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:19.154855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:19.163018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3bd24dac-5741-40f9-9776-b41a0586d0ec tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.161879 Aug 24 15:30:19.163916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 262/517] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:18 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:19.584416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:19.585013 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:19.591845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:19.592494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:19.592993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:19.593699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:19.594201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:19.594678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:19.733513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:19.741351 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d8f0bf8d-c218-4cc8-9db3-db0acf55119e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.160801 Aug 24 15:30:19.742043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 256/518] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:19 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:19.964915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:19.965584 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:19.972190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:19.972672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:19.973101 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:19.973794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:19.974366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:19.974783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.001302 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:20.002946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:20.011457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:20.012047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:20.012723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.013614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:20.014299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:20.014838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.044330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:20.053568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-131b9c3a-403f-4fa8-b35d-781798126bbb tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.092436 Aug 24 15:30:20.054145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 263/519] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:19 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:20.165471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:20.173700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9387a1ce-76c0-4c01-8d26-c9bc1eee6ca9 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.176314 Aug 24 15:30:20.174702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 257/520] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:19 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:20.185173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:20.185791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:20.192161 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:20.192648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:20.193081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.193789 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:20.194317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:20.194683 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.417171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:20.425731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3a793f03-ad23-469c-bdaf-111bb77779f8 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.244607 Aug 24 15:30:20.426256 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 264/521] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:20 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:20.763281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:20.763634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:20.769642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:20.770125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:20.771170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.771280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:20.771720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:20.772146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:20.920235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:20.928876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-640b9c34-7efd-477b-b1e8-3dd1b8e9576a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.169846 Aug 24 15:30:20.930317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 258/522] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:20 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:21.075941 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:21.076840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:21.084245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.085005 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.085427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.087077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.087534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.087953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.154729 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:21.162740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a60c3b26-70eb-4553-945f-b204852e64a9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.090636 Aug 24 15:30:21.163393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 265/523] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:21 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:21.197132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:21.197845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:21.204225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.204693 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.205125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.206450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.206697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.207543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.348204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:21.356321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-caf10978-48c7-445d-85e2-c63dff7adee2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.163491 Aug 24 15:30:21.356899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 259/524] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:21 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:21.447193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:21.447799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:21.453905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.454435 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.454870 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.455561 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.456014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.456439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.585595 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:21.593372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7b75e276-8781-4fa3-bed2-eeaddea50972 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.150671 Aug 24 15:30:21.593866 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 266/525] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:21 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:21.950421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:21.951025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:21.956953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.957418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.957926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:21.958542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:21.958986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:21.959407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.084481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:22.092668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9115ed20-196b-47e0-8daa-ad9fba4604a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.146044 Aug 24 15:30:22.093263 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 260/526] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:21 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:22.184462 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:22.185255 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:22.191926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:22.192407 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:22.192843 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.193537 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:22.193988 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:22.194448 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.259033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:22.266747 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3611858d-d082-4541-af34-6c80a3b99c48 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.086311 Aug 24 15:30:22.267282 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 267/527] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:22 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:22.377783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:22.378391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:22.385000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:22.385479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:22.385908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.386638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:22.387080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:22.387496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.522699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:22.525641 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:22.533723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a2555d66-ab6f-4132-8376-9dc09212d7e7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.159688 Aug 24 15:30:22.534325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 261/528] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:22 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:22.614010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:22.614653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:22.620871 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:22.621352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:22.621784 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.622502 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:22.622955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:22.623372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:22.759669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:22.767545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d2e2848c-1f89-4b93-b3fe-f3a85546c032 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.157334 Aug 24 15:30:22.768115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 268/529] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:22 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:23.113605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:23.114132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:23.121064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.121534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.121977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.122678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.123125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.123540 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.249447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:23.256952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9de441f7-48e9-4d89-88d7-a893329c9391 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.147314 Aug 24 15:30:23.257513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 262/530] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:23 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:23.288286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:23.288916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:23.296227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.296706 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.297141 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.297832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.298321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.298753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.361618 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:23.365042 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:23.370113 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-51c68453-1954-4083-a52e-12d3580d7b94 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1472 microversion: 2.1 time: 0.085677 Aug 24 15:30:23.370706 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 269/531] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:23 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:23.556118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:23.556713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:23.562515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.562994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.563468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.564142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.564584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.565001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.692524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:23.700227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-48540903-fbb9-4e75-8235-1b64cf9d2018 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.149669 Aug 24 15:30:23.700802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 263/532] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:23 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:23.790002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:23.790635 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:23.796575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.797018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.797442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.798126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:23.798601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:23.799022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:23.929350 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:23.937111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5a921553-2b1d-4432-adc0-9134ff779f37 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.151831 Aug 24 15:30:23.937663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 270/533] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:23 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:24.277045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:24.277797 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:24.284105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.284592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.285026 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.285708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.286154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.286624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.391200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:24.392400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:24.403996 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.404502 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.404947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.405658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.406310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.406911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.426329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:24.440409 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e96ac842-9927-4f6f-aa01-a070bf3f6312 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.167179 Aug 24 15:30:24.445940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 264/534] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:24 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:24.502186 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:24.509868 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-56330f4d-5322-4f17-b9a6-e208861fc8e0 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1304 microversion: 2.1 time: 0.122628 Aug 24 15:30:24.510475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 271/535] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:24 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:24.656997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-cfe4a657-7acd-4715-b403-241941a73a62 req-129e6172-9dd5-4706-82e5-5de60d0db7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:24.667335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-cfe4a657-7acd-4715-b403-241941a73a62 req-129e6172-9dd5-4706-82e5-5de60d0db7ec service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.667891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-cfe4a657-7acd-4715-b403-241941a73a62 req-129e6172-9dd5-4706-82e5-5de60d0db7ec service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.668381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-cfe4a657-7acd-4715-b403-241941a73a62 req-129e6172-9dd5-4706-82e5-5de60d0db7ec service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.679174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-cfe4a657-7acd-4715-b403-241941a73a62 req-129e6172-9dd5-4706-82e5-5de60d0db7ec service nova] Creating event network-changed:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:30:24.684973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-cfe4a657-7acd-4715-b403-241941a73a62 req-129e6172-9dd5-4706-82e5-5de60d0db7ec service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031601 Aug 24 15:30:24.685568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 265/536] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:24.720717 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:24.721321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:24.727660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.728138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.728563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.729238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.729688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.730102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.861033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:24.871635 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5911e840-cc83-4432-b69e-79f68d0de721 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.154713 Aug 24 15:30:24.872191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 272/537] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:24 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:24.959125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:24.959818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:24.967663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.968141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.968604 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:24.969294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:24.969738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:24.970162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.100684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:25.108906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-23bf2146-5d63-4a6f-991e-1cd3ec6a181e tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.153869 Aug 24 15:30:25.109470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 266/538] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:24 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:25.462962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:25.463569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:25.472952 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.474131 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.474635 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.475321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.476345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.477095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.531296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:25.531554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:25.539067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.539238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.539916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.541156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.541156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.541721 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.575168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:25.579494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.579976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.580405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.580849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lazy-loading 'fault' on Instance uuid d102fd3a-a604-4ee9-a585-64564a60a2c3 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:30:25.631128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:25.639551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f5b22c3e-3053-4bdc-861c-3c9ef8d7d56e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 200 len: 1309 microversion: 2.1 time: 0.112431 Aug 24 15:30:25.640162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 267/539] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:25 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:25.640899 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:25.650163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0ee237c5-3c84-49fa-a541-d524e9cf98d7 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.191657 Aug 24 15:30:25.653494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 273/540] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:25 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:25.891923 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:25.892457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:25.898914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.899398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.899838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:25.900524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:25.900983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:25.901410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.034296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:26.042669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ce9aa1b2-0640-4c71-84ad-db8dc13991db tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.154739 Aug 24 15:30:26.043236 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 268/541] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:25 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:26.129735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:26.130376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:26.136326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.136808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.137263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.137928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.138788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.138788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.340050 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:26.362921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6d043c86-ac67-42fb-9e4f-664131561d6b tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1504 microversion: 2.1 time: 0.237111 Aug 24 15:30:26.368117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 274/542] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:26 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:26.663079 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:26.663744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: d102fd3a-a604-4ee9-a585-64564a60a2c3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:26.671892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:26.673124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:26.673751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.674614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.675157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.676019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.676464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.676886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.680330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.680822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.681290 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.686534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.687294 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.689925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.693173 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] HTTP exception thrown: Instance d102fd3a-a604-4ee9-a585-64564a60a2c3 could not be found. Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Request method failure captured: Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 HTTP/1.1 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkNwwrM-oBthXouE-L9m5FMsPbvEThb6dv6VwXJKTJUECEn--kYUC2Xi1XnPsiDBb2zFGB3C5daiOJHOgUqHvs7CqKqRslIJMx9MpBa_Xjm8gzHhohp8m6mVRmB2LafKAuoGoyTSsfQSKVW8UR4S0Rqvac9Phh1fsSqqKvZSAuOoBx8 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 00071111c84346639e5245e5c173dad5 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesSnapshotTestJSON-334503720 Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:30:26.695095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/00071111c84346639e5245e5c173dad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/00071111c84346639e5245e5c173dad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_00071111c84346639e5245e5c173dad5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/00071111c84346639e5245e5c173dad5"}]}] Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesSnapshotTestJSON-334503720 Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 00071111c84346639e5245e5c173dad5 Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-334503720 Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesSnapshotTestJSON-334503720-project Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 22c5f040350d4daba0ebe2af86849a23 Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesSnapshotTestJSON-334503720-project Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d102fd3a-a604-4ee9-a585-64564a60a2c3 could not be found. Aug 24 15:30:26.696520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'd102fd3a-a604-4ee9-a585-64564a60a2c3'} Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d102fd3a-a604-4ee9-a585-64564a60a2c3 could not be found. Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:30:26.697329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d102fd3a-a604-4ee9-a585-64564a60a2c3 could not be found. Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d102fd3a-a604-4ee9-a585-64564a60a2c3 could not be found. Aug 24 15:30:26.698960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:26.700275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Returning 404 to user: Instance d102fd3a-a604-4ee9-a585-64564a60a2c3 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:30:26.700275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1f318ae1-b595-4674-ac41-4a132fec35bd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3" status: 404 len: 111 microversion: 2.1 time: 0.037392 Aug 24 15:30:26.700275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 269/543] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:26 2022] GET /compute/v2.1/servers/d102fd3a-a604-4ee9-a585-64564a60a2c3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:30:26.782382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-8724cc4c-858a-481f-b0fc-d518ce32df26 req-71054dae-c18f-4a81-966d-c81d117056a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89b2a7d-94fc-4c71-b695-8576be4e9a01", "name": "network-vif-deleted", "tag": "e3306819-1a9c-4955-af00-8d58acc2ff45"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:26.792615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-8724cc4c-858a-481f-b0fc-d518ce32df26 req-71054dae-c18f-4a81-966d-c81d117056a6 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:26.793302 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-8724cc4c-858a-481f-b0fc-d518ce32df26 req-71054dae-c18f-4a81-966d-c81d117056a6 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:26.793909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-8724cc4c-858a-481f-b0fc-d518ce32df26 req-71054dae-c18f-4a81-966d-c81d117056a6 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:26.808423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-8724cc4c-858a-481f-b0fc-d518ce32df26 req-71054dae-c18f-4a81-966d-c81d117056a6 service nova] Creating event network-vif-deleted:e3306819-1a9c-4955-af00-8d58acc2ff45 for instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 on hv-cinder-84890 Aug 24 15:30:26.814362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-8724cc4c-858a-481f-b0fc-d518ce32df26 req-71054dae-c18f-4a81-966d-c81d117056a6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035540 Aug 24 15:30:26.815119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 270/544] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:30:26.866835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:26.874495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9565c08a-11fd-4f62-beba-77235b5732d8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.206395 Aug 24 15:30:26.875054 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 275/545] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:26 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:27.063981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:27.064669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:27.070788 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:27.071264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:27.071691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:27.072368 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:27.072812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:27.073227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:27.201482 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:27.209214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5e68698b-518f-47ef-b822-a0c34277b10e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.150036 Aug 24 15:30:27.209769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 271/546] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:27 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:27.384669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:27.385272 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:27.391135 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:27.391607 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:27.392034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:27.392710 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:27.393156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:27.393571 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:27.454491 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:27.462104 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2f72b407-c22f-4e84-9607-048fc9098520 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1462 microversion: 2.1 time: 0.081878 Aug 24 15:30:27.462691 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 276/547] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:27 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:27.894950 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:27.895476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:27.901443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:27.901911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:27.902378 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:27.903058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:27.903504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:27.903917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:28.037813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:28.044816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c79d9c1d-1fe7-4816-b7e9-8a037f0b8d27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.153835 Aug 24 15:30:28.045371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 272/548] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:27 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:28.230111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:28.230747 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:28.237071 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:28.237539 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:28.237963 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:28.238677 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:28.239187 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:28.239605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:28.373453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:28.380990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3da9b4f7-1e98-4ad3-a28d-851976b2d0a5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.155466 Aug 24 15:30:28.381542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 277/549] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:28 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:28.483168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:28.483727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:28.490291 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:28.490780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:28.491325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:28.492117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:28.492510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:28.492966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:28.558441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:28.566019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fbbd9a19-def1-44ee-ac72-27dad850cf89 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1462 microversion: 2.1 time: 0.086826 Aug 24 15:30:28.566605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 273/550] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:28 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:29.067669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:29.071662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:29.078469 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:29.078956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:29.079389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:29.080096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:29.080544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:29.080964 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:29.214818 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:29.222761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-34d5763e-3ac8-4cea-8fc8-ece10104fc94 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.160757 Aug 24 15:30:29.223692 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 278/551] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:29 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:29.402741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:29.403358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:29.409835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:29.410432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:29.410875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:29.411684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:29.412199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:29.412628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:29.550592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:29.558549 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0da7b991-5c15-419c-a955-697bcd775dc8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.160270 Aug 24 15:30:29.559192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 274/552] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:29 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:29.588142 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:29.588880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:29.595740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:29.596361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:29.596873 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:29.597658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:29.598207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:29.598762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:29.665326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:29.674009 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bb3d27d9-5b53-4af6-8a2d-f0963aebc26d tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1462 microversion: 2.1 time: 0.090294 Aug 24 15:30:29.674718 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 279/553] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:29 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:30.243913 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:30.244672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:30.251309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:30.251868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:30.252374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:30.253138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:30.253588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:30.254013 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:30.384730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:30.392691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2a15902f-df9f-4515-9826-9d16811390fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.153439 Aug 24 15:30:30.393266 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 275/554] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:30 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:30.579917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:30.580534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:30.586588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:30.587065 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:30.587494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:30.588180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:30.588759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:30.589028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:30.696787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:30.697412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:30.704326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:30.704812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:30.705447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:30.707371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:30.707831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:30.708445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:30.725377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:30.735826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d19593b0-c633-4a3e-aaf6-0f568a2e2125 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.159653 Aug 24 15:30:30.738322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 280/555] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:30 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:30.776990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:30.785269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4637891d-9d11-4bed-beb0-ab47838ca740 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1462 microversion: 2.1 time: 0.093100 Aug 24 15:30:30.785773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 276/556] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:30 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:31.413626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:31.414549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:31.420538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:31.421017 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:31.421450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:31.422136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:31.422662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:31.423078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:31.561688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:31.569426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4d7ac96b-c21f-478f-9f52-f51731865db9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.159745 Aug 24 15:30:31.569979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 281/557] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:31 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:31.756929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:31.757654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:31.764228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:31.764702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:31.765132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:31.765817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:31.766307 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:31.766722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:31.812356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:31.813048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:31.833375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:31.835027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:31.837111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:31.838131 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:31.839272 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:31.841348 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:31.937515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:31.944301 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ba5db8353847d7b14ba2d4cb391073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7292443f39f548e79c3bb9d07bccb0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:31.961627 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3b4c5c41-fa0f-4b91-90d9-a640cdab84e2 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 200 len: 1299 microversion: 2.1 time: 0.153085 Aug 24 15:30:31.965906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 282/558] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:31 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:31.980550 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0239ed80-3c14-44ca-8704-ee0be1304fdf tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.227309 Aug 24 15:30:31.981727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 277/559] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:31 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:32.590189 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:32.590804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:32.596882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:32.597363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:32.597796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:32.598560 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:32.599013 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:32.599464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:32.748951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:32.756845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d365b1c2-ecda-457d-8f32-47453a5d3bae tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.171031 Aug 24 15:30:32.757401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 283/560] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:32 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:32.983513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:32.984137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] [instance: c89b2a7d-94fc-4c71-b695-8576be4e9a01] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:32.990659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:32.991133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:32.991558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:32.992241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:32.992685 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:32.993101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:33.002538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:33.003439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:33.007014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] HTTP exception thrown: Instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 could not be found. Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Request method failure captured: Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 HTTP/1.1 Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkOIJbiAgoFCCBdDf4CfAJOeXtSvoF-LY--Byj94DXWh18BXAWl1LvGFsCpvfmv3mOU_Qjn1pL3glBB8vKBOVENiOvJ8mtTaYx0_PhxXf_2_q1-6oTaqx-v6w-JRtlkiCAkrn7UZS-zDz9XKhjAQ0zVwK9nl3HBrya7iD1hB48RDcx0 Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 7292443f39f548e79c3bb9d07bccb0df Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesActionsTest-743420610 Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:30:33.009143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7292443f39f548e79c3bb9d07bccb0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7292443f39f548e79c3bb9d07bccb0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7292443f39f548e79c3bb9d07bccb0df", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7292443f39f548e79c3bb9d07bccb0df"}]}] Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesActionsTest-743420610 Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 7292443f39f548e79c3bb9d07bccb0df Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesActionsTest-743420610 Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesActionsTest-743420610-project Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 22ba5db8353847d7b14ba2d4cb391073 Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesActionsTest-743420610-project Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 could not be found. Aug 24 15:30:33.010760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'c89b2a7d-94fc-4c71-b695-8576be4e9a01'} Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 could not be found. Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:30:33.011494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 could not be found. Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 could not be found. Aug 24 15:30:33.012660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:33.013938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] Returning 404 to user: Instance c89b2a7d-94fc-4c71-b695-8576be4e9a01 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:30:33.014014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:33.014014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:33.014014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:33.014361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-601c835a-26e4-4681-80fb-a6daeffd4ec1 tempest-VolumesActionsTest-743420610 tempest-VolumesActionsTest-743420610-project] 10.222.0.76 "GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01" status: 404 len: 111 microversion: 2.1 time: 0.031662 Aug 24 15:30:33.014462 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:33.014553 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 278/561] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:32 2022] GET /compute/v2.1/servers/c89b2a7d-94fc-4c71-b695-8576be4e9a01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:30:33.014640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:33.014640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:33.166525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:33.177660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4a4cd2cc-7ecd-470c-a61d-2d8d1819e1e1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.178492 Aug 24 15:30:33.181852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 284/562] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:32 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:33.777031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:33.778030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:33.785744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:33.786452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:33.789372 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:33.790100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:33.790817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:33.791170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:33.942483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:33.950211 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5dbe60c2-4251-45c9-ac6d-0b94510c2cc5 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.177217 Aug 24 15:30:33.950791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 279/563] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:33 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:34.202371 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:34.202994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:34.209729 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:34.210242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:34.211216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:34.211889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:34.212349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:34.212781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:34.350098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:34.358750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-636c4c8f-e1b3-4df2-8d4b-847b0794ea1b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.160213 Aug 24 15:30:34.359616 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 285/564] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:34 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:34.971591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:34.972200 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:34.979877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:34.980393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:34.980780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:34.981465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:34.981908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:34.982397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:35.112900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:35.115212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:35.122501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d952b065-a346-41a3-a7cd-5412834aebec tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.154715 Aug 24 15:30:35.123068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 280/565] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:34 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:35.380397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:35.380920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:35.387566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:35.388052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:35.388495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:35.389201 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:35.389985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:35.392197 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:35.414591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:35.536770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:35.544582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a2a14f33-9280-4a5e-a765-74c86e0c98e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.168097 Aug 24 15:30:35.545322 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 286/566] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:35 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:36.144459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:36.144983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:36.152248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:36.153210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:36.153210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:36.154323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:36.155103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:36.155103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:36.304960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:36.314149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8392d1a0-46d4-493c-8c0e-d8098c6e4e1f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.173854 Aug 24 15:30:36.314868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 281/567] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:36 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:36.565262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:36.566433 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:36.568782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:36.576080 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:36.576903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:36.577344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:36.578055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:36.578543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:36.579599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:36.744442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:36.752004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3cda7025-6dfd-4194-981d-42cb9ad219d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.190654 Aug 24 15:30:36.752645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 287/568] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:36 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:37.335741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:37.336370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:37.342963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:37.343436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:37.343864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:37.344542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:37.344987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:37.345403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:37.472311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:37.480202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d7de33b3-0830-4086-8d6d-a076a91af90a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.148413 Aug 24 15:30:37.480860 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 282/569] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:37 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:37.772816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:37.774130 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:37.780515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:37.780986 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:37.781414 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:37.782090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:37.782569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:37.783231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:37.915825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:37.923391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-57248ff2-b444-45f1-8e22-414ed77efbef tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.154386 Aug 24 15:30:37.923944 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 288/570] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:37 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:38.501424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:38.502185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:38.509803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:38.510367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:38.510806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:38.511509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:38.511952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:38.512379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:38.641473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:38.649162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5da9dd6f-4aa6-4dcd-8fb7-bccb1c74900b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.151683 Aug 24 15:30:38.649723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 283/571] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:38 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:38.767715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1577528599", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "networks": [{"uuid": "34be3f10-b199-452c-9836-0433866560c3"}]}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:38.819129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] validate_networks() for [('34be3f10-b199-452c-9836-0433866560c3', None, None, None, None, None)] {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:30:38.944153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:38.944768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:38.953532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:38.954144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:38.954805 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:38.955516 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:38.956073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:38.956901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:39.095810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:39.106772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-90cc346a-9cad-4237-95fe-fab28800381c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.166285 Aug 24 15:30:39.107535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 284/572] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:38 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:39.189782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:30:39.190257 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:30:39.190739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:30:39.191179 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:30:39.191589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:30:39.200421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:39.200901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:39.201340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:39.202067 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:39.202568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:39.202994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:39.219435 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Getting quotas for project 00071111c84346639e5245e5c173dad5. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:30:39.223375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Getting quotas for user 22c5f040350d4daba0ebe2af86849a23 and project 00071111c84346639e5245e5c173dad5. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:30:39.234611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:30:39.236909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:30:39.281897 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ee35be31-ddcb-4659-b74a-b7f56791ddff tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517897 Aug 24 15:30:39.282579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 289/573] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:30:39.294280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4940a17a-e099-4f09-bc8a-c5313dc4aba1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:39.294831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4940a17a-e099-4f09-bc8a-c5313dc4aba1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:39.347276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4940a17a-e099-4f09-bc8a-c5313dc4aba1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:39.354891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4940a17a-e099-4f09-bc8a-c5313dc4aba1 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1219 microversion: 2.1 time: 0.064801 Aug 24 15:30:39.355784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 285/574] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:39 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:39.670602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:39.671223 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:39.677395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:39.677878 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:39.678338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:39.679039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:39.680003 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:39.680430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:39.812204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:39.819959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-70aa7a49-eab2-4c1d-8a25-fbb89b37ffff tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.153569 Aug 24 15:30:39.820563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 290/575] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:39 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:40.127543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:40.128148 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:40.134092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:40.134608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:40.135035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:40.135733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:40.136168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:40.136588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:40.266622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:40.274738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-100f2daa-241c-4874-b883-35fe98757cbe tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.151050 Aug 24 15:30:40.275295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 286/576] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:40 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:40.374611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:40.375253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:40.381041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:40.381541 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:40.381969 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:40.382699 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:40.383146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:40.383562 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:40.443431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:40.452285 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-202af850-cb32-47ee-8902-ea0c32fc73ae tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1223 microversion: 2.1 time: 0.081465 Aug 24 15:30:40.452835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 291/577] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:40 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:40.840411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:40.840941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:40.847349 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:40.847826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:40.848257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:40.848939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:40.849393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:40.849817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:40.978268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:40.985979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fe00208e-17df-4176-bf7a-582c1d986871 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.150073 Aug 24 15:30:40.986562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 287/578] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:40 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:41.295822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:41.296420 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:41.302913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:41.303388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:41.303813 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:41.304513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:41.304961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:41.305377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:41.434934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:41.442637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c33d9d96-abbd-40ed-8be6-30bb2795e440 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.150761 Aug 24 15:30:41.443200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 292/579] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:41 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:41.472910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:41.473517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:41.479950 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:41.480421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:41.480849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:41.481522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:41.481968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:41.482423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:41.542559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:41.550190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aaec201b-76b7-42ba-8054-eff54ea62733 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1223 microversion: 2.1 time: 0.080950 Aug 24 15:30:41.550719 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 288/580] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:41 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:42.006767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:42.008018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:42.013999 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:42.014525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:42.014958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:42.015643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:42.016096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:42.016520 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:42.142144 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:42.149701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-65ef26cf-ed21-4474-80d2-e00c39aa5cb9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.146708 Aug 24 15:30:42.150284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 293/581] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:42 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:42.464376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:42.464976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:42.471441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:42.471909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:42.472334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:42.473002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:42.473555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:42.473849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:42.570945 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:42.571667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:42.578252 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:42.578842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:42.579346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:42.580120 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:42.580649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:42.581234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:42.605913 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:42.613830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-50c4d5a0-f288-4031-8c7f-ad792f3fb616 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.153759 Aug 24 15:30:42.614689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 289/582] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:42 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:42.644107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:42.652311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-36613ae3-689c-4f1d-ab50-e71b3a2aba83 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1223 microversion: 2.1 time: 0.085190 Aug 24 15:30:42.652831 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 294/583] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:42 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:43.170802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:43.171452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:43.177522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.178003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.178460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.179168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.179621 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.180078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.271912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:43.272401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:43.278702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.279641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.279641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.280279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.280723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.281274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.305778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0c023c48-4643-47b7-9509-759a283c9f13 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/ips" status: 200 len: 153 microversion: 2.20 time: 0.037556 Aug 24 15:30:43.306586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 295/584] 10.222.0.76 () {60 vars in 1289 bytes} [Wed Aug 24 15:30:43 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:30:43.313520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:43.321214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6436d78f-5263-44e0-9a6e-8c165305366f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.154301 Aug 24 15:30:43.321925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 290/585] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:43 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:43.635333 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:43.636087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:43.642555 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.643112 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.643617 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.644435 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.644981 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.645475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.673783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:43.674436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:43.680999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.681611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.682138 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.682954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:43.683474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:43.683971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:43.747596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:43.755673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8e06e854-21a1-40d5-986b-c4d1c3410b17 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1223 microversion: 2.1 time: 0.085574 Aug 24 15:30:43.756263 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 291/586] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:43 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:43.780762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:43.788667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-453271ff-686f-42c7-a5cd-0d0f5afa3110 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.157704 Aug 24 15:30:43.789177 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 296/587] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:43 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:44.342688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:44.343914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:44.363358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.364144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.364720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.365585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.366186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.366851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.610790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:44.637323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cd016bbd-4ff0-4d5a-baab-24323052f88d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.296599 Aug 24 15:30:44.641376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 292/588] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:44 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:44.724767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-5400a7eb-0aaa-4588-ad18-8bf4d2773aa6 req-2412f396-3c4a-4cb4-b33d-6fa83df12ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "name": "network-vif-plugged", "status": "completed", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:44.744338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5400a7eb-0aaa-4588-ad18-8bf4d2773aa6 req-2412f396-3c4a-4cb4-b33d-6fa83df12ab0 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.744823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5400a7eb-0aaa-4588-ad18-8bf4d2773aa6 req-2412f396-3c4a-4cb4-b33d-6fa83df12ab0 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.745250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5400a7eb-0aaa-4588-ad18-8bf4d2773aa6 req-2412f396-3c4a-4cb4-b33d-6fa83df12ab0 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.766544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-5400a7eb-0aaa-4588-ad18-8bf4d2773aa6 req-2412f396-3c4a-4cb4-b33d-6fa83df12ab0 service nova] Creating event network-vif-plugged:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:30:44.774696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-5400a7eb-0aaa-4588-ad18-8bf4d2773aa6 req-2412f396-3c4a-4cb4-b33d-6fa83df12ab0 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054612 Aug 24 15:30:44.775300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 297/589] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:44.778128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:44.779697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:44.787414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.789122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.790038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.795376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.796203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.796783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.810037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:44.811122 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:44.824486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.825111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.825653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.826405 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:44.826995 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:44.827562 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:44.894474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:44.905067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d47e3533-b6c5-4740-aed6-bf7b55f0ea5d tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1271 microversion: 2.1 time: 0.131807 Aug 24 15:30:44.905887 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 293/590] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:44 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:45.016742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:45.029867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cf913e60-cb1b-4133-8456-fef7102ac7e8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.224237 Aug 24 15:30:45.031057 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 298/591] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:44 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:45.522140 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:45.522739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:45.537121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:45.538119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:45.538638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:45.539360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:45.541596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:45.542039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:45.575612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lazy-loading 'flavor' on Instance uuid 0ded4f04-fa28-4ffa-9541-fc8944cbe89a {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:30:45.660740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:45.661659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:45.675792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:45.677664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:45.678481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:45.680794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:45.681376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:45.682548 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:45.966392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-39d75bbe-af8a-4ffe-9f42-11656e483da5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/action" status: 202 len: 0 microversion: 2.20 time: 0.448871 Aug 24 15:30:45.974213 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 294/592] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 15:30:45 2022] POST /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:30:45.992859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:45.993851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:46.005254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.011246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.012030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.017072 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.017762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.018435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.093748 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:46.102797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-84019745-c0b6-455a-8337-d785d655f91e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.445991 Aug 24 15:30:46.113884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 299/593] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:45 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:46.113884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:46.113884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:46.121779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.122320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.122738 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.123445 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.123895 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.124312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.126837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:46.135026 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e38b225b-1eec-4036-90dc-f69c799a8c7f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1277 microversion: 2.1 time: 0.154418 Aug 24 15:30:46.135614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 295/594] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:45 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:46.140823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:46.141436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:46.147603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.148751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.149194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.149910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.150412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.150856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.167560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:46.312681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:46.324807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7810b805-e948-4b42-b24d-986a96f81c6b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1503 microversion: 2.1 time: 0.187704 Aug 24 15:30:46.325348 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 296/595] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:46 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:46.343591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:46.356151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:46.358207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:46.359682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4c91856a-cdd8-4a31-9990-f007cbe680ac tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.253569 Aug 24 15:30:46.360558 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 300/596] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:46 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:46.363503 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcbffc15-eb32-403e-af7f-f20163845578"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:46.368256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:46.375049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.375535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.375968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.376670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.377123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.377715 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.403557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] HTTP exception thrown: Cannot 'attach_volume' instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 while it is in vm_state rescued Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Request method failure captured: Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/os-volume_attachments HTTP/1.1 Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 74 Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkOSc0dE1xmstci05otrZ4SP53WpoaOzS1Ogt7qYougQw2n0gIk-qn2dvMXW6wpsW7hGtRVeSwRBPOZbpZh7ufzHxLW7NWcB0n3NG1F-M-tnJTGAVtQ_jgvFGgVl2J1Vcge2SUZXR0zVL4wn80zYXRIrwoiQ929leEWqwq6YTS-oizw Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:30:46.405268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ce23bc924f714d72ad20d32a3f5b6d25", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}] Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 461b9a3987744067a62234aaa8d086d0 Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {"volumeAttachment": {"volumeId": "dcbffc15-eb32-403e-af7f-f20163845578"}} Aug 24 15:30:46.406663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Cannot 'attach_volume' instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 while it is in vm_state rescued Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'server_id': 'e9f66ab1-18d5-41d8-b752-d6a00fd893b4', 'body': {'volumeAttachment': {'volumeId': 'dcbffc15-eb32-403e-af7f-f20163845578'}}} Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:30:46.407457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 while it is in vm_state rescued Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:30:46.408954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 while it is in vm_state rescued Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Returning 409 to user: Cannot 'attach_volume' instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 while it is in vm_state rescued {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7617f4d0-c50e-4c64-a29c-bf8006be27f5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051184 Aug 24 15:30:46.410128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 297/597] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:30:46 2022] POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:30:46.419557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:46.420207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:46.427783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.428431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.429038 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.430085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.430900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.431442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.512726 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dcb8e49c-a80c-48b4-bb67-fd630c1f8a38 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/action" status: 202 len: 0 microversion: 2.1 time: 0.099488 Aug 24 15:30:46.514005 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 301/598] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:30:46 2022] POST /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:30:46.521986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:46.522626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:46.531254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.531898 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.532344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.533757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:46.533898 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:46.534353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:46.994029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:47.017780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ca5d5148-ca1c-4c06-9bc9-c78c9aae1ced tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1511 microversion: 2.1 time: 0.498260 Aug 24 15:30:47.022422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 298/599] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:46 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1511 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:47.125614 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:47.127085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:47.134672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:47.135640 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:47.136297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:47.137234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:47.137970 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:47.138549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:47.165214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:47.167272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:47.189190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:47.190315 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:47.191060 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:47.192829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:47.199468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:47.200515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:47.337107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:47.356978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b0a0e756-6e4b-4039-9fb4-81509ef2a2c3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1277 microversion: 2.1 time: 0.199495 Aug 24 15:30:47.372384 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:47.375433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 299/600] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:47 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:47.378335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-da9e41c9-cfe2-4bbd-86c2-7336d2027f1b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1358 microversion: 2.1 time: 0.255178 Aug 24 15:30:47.379516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 302/601] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:47 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:47.387720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:47.389131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:47.400623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:47.401495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:47.402157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:47.403221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:47.403893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:47.405298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:47.918723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:47.928678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:47.931146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:47.932642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e5b92309-fa8e-4b16-9cc9-f7513b709755 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.553438 Aug 24 15:30:47.948412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 300/602] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:47 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:30:48.046250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:48.047263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:48.056419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.056936 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.057367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.058085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.058582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.059006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.219193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:48.223081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:48.229825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-86daf0eb-35f0-4a95-9561-430b6627373f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1511 microversion: 2.1 time: 0.190549 Aug 24 15:30:48.230700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 303/603] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:48 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:48.379940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:48.381510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:48.388857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.389766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.390660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.391628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.392298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.392933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.406750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:48.410037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:48.430173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.438378 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.441244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.442909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.446662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.448248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.625613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:48.637535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ab89d31c-4f79-41cd-b1f7-3a9dfe2855b4 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1548 microversion: 2.1 time: 0.234865 Aug 24 15:30:48.641301 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 304/604] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:48 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1548 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:48.666667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:48.667512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:48.667809 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:48.674713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.675579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-67db54e4-1ace-4628-9405-2d48f4234a09 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.299638 Aug 24 15:30:48.676224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.676826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.677870 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.678527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.679783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 301/605] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:48 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:48.680882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.951690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:48.961261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:48.962252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:48.969119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e3577587-ef09-4696-9252-9ffa8c8c3b12 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1548 microversion: 2.1 time: 0.306306 Aug 24 15:30:48.972349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 305/606] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:48 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1548 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:48.979816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.983217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.984485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:48.986527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:48.991250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:48.992281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:48.992976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.000129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:49.001156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Searching by: {'deleted': False, 'project_id': '60386a4f71754e4396434dfa34c55b75'} {{(pid=120848) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 15:30:49.027420 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.027921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.028342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.029077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.029535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.029959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.200033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.multi_cell_list [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120848) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 15:30:49.231114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:49.281333 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:49.296113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:49.298168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:49.306053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fd5295e9-4006-4ee6-9b47-0bb17e89f9d7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.349827 Aug 24 15:30:49.324395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d8565dbb-53b5-49df-bb26-9aff89a33143 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.323148 Aug 24 15:30:49.324395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 306/607] 10.222.0.76 () {58 vars in 1125 bytes} [Wed Aug 24 15:30:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:49.324395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:49.324395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:49.326061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 302/608] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:48 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:49.331035 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.331631 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.331768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:49.332160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.332938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:49.333064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.333522 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.334023 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.342717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.343592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.344296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.345260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.346279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.346935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.351947 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:49.544479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:49.556258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:49.557859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9b267382-074d-4e4e-85b0-686c670147ba tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1548 microversion: 2.1 time: 0.230253 Aug 24 15:30:49.570506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0d0eadf0-18c2-4e23-8535-af81d29517d4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1511 microversion: 2.1 time: 0.246277 Aug 24 15:30:49.570506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 307/609] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:49 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:49.571226 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 303/610] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:49 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:49.701631 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:49.702449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:49.718263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.718777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.719300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.720793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.724010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.725950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.785955 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-3e1eb307-ab6a-4d13-b7da-859bde76be75 req-409811fd-191a-4b9a-9fd3-dc4d0e7dfd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0ccb78-7647-4852-97e6-65c22d4637d3", "tag": "da5494c3-1aed-4b57-8a4d-033c8c666fd9"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:49.808334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-3e1eb307-ab6a-4d13-b7da-859bde76be75 req-409811fd-191a-4b9a-9fd3-dc4d0e7dfd2b service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:49.811039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-3e1eb307-ab6a-4d13-b7da-859bde76be75 req-409811fd-191a-4b9a-9fd3-dc4d0e7dfd2b service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:49.814560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-3e1eb307-ab6a-4d13-b7da-859bde76be75 req-409811fd-191a-4b9a-9fd3-dc4d0e7dfd2b service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:49.832964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-3e1eb307-ab6a-4d13-b7da-859bde76be75 req-409811fd-191a-4b9a-9fd3-dc4d0e7dfd2b service nova] Creating event network-changed:da5494c3-1aed-4b57-8a4d-033c8c666fd9 for instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 on hv-cinder-84890 Aug 24 15:30:49.840073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-3e1eb307-ab6a-4d13-b7da-859bde76be75 req-409811fd-191a-4b9a-9fd3-dc4d0e7dfd2b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059103 Aug 24 15:30:49.841505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 304/611] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:30:50.002041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:50.011768 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-516300f1-3522-4f00-904f-56bbcfe6cfd8 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.317415 Aug 24 15:30:50.015367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 308/612] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:49 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:50.335956 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:50.337186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:50.347155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:50.348579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:50.349509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:50.350475 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:50.351597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:50.352179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:50.517967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:50.527952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:50.529855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:50.531335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-12fd11ae-bd9c-439a-a23b-5e0f27927b53 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.202415 Aug 24 15:30:50.532064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 305/613] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:50 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:50.592934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:50.594374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:50.602269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:50.602904 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:50.603657 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:50.604690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:50.605250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:50.605782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:50.781869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:50.793330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3f232364-59fa-47fa-9790-cfd37a0b7097 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1511 microversion: 2.1 time: 0.204230 Aug 24 15:30:50.794385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 309/614] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:50 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:51.039799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:51.041078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:51.047547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.048282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.048820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.049591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.050111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.050775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.247171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:51.255611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5f2765eb-299b-43c6-bbaa-2d4b68b97efd tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.220528 Aug 24 15:30:51.256135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 306/615] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:51 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:51.417653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7ee5e6e-1e40-45c5-b878-29bca03647be"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:51.420260 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:51.427676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.428273 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.428946 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.430051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.430716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.431500 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.562372 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:51.563315 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:51.579751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.580625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.581457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.582419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.583077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.583719 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.827556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:51.836963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:51.838497 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:51.839672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-52713c02-b0de-4f3b-8b0c-8e8d23285fcc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.282147 Aug 24 15:30:51.840652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 307/616] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:51 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:30:51.845519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:51.846352 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:51.853859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.854595 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.855218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:51.856103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:51.856716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:51.857304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:52.008259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:52.016621 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-898a86da-2088-4afc-bd87-e68244c8eb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1511 microversion: 2.1 time: 0.174504 Aug 24 15:30:52.017506 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 308/617] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:51 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:52.278687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:52.280244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:52.301660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:52.302317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:52.304277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:52.305102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:52.305530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:52.308129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:52.407550 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-06cb28cb-9269-4c76-b04a-e8ad442338e8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994879 Aug 24 15:30:52.409216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 310/618] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:30:51 2022] POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments => generated 194 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:52.595133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:52.605224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-91fa5a71-768c-4ff7-a968-25afedb16fa9 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.331279 Aug 24 15:30:52.606690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 309/619] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:52 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:52.868485 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:52.869559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:52.878972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:52.880145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:52.880845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:52.881756 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:52.882491 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:52.883159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:53.044543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:53.046248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:53.048562 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:53.061494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:53.062993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:53.064954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:53.067610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:53.068331 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:53.070419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:53.070857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:53.071177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:53.072466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cf2abeab-e849-47a7-acd2-57647c508aad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.209672 Aug 24 15:30:53.073782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 311/620] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:52 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:53.455647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:53.465429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-474d9330-e73c-449c-b659-ce9f625eef64 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1517 microversion: 2.1 time: 0.426033 Aug 24 15:30:53.466038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 310/621] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:53 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1517 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:53.626993 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:53.627770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:53.633582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:53.634074 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:53.634537 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:53.635240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:53.635707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:53.636117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:53.900090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:53.910070 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-273a7cd9-59a9-4ede-b61a-8ca3fdc797cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.287324 Aug 24 15:30:53.910692 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 312/622] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:53 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:54.096667 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:54.097335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:54.107410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:54.107967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:54.108415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:54.109208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:54.109782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:54.110165 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:54.276468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:54.284927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:54.286468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:54.287736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c21b4849-0718-4475-b18d-bd624d2d27a2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.195511 Aug 24 15:30:54.288893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 311/623] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:54 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:54.932455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:54.933213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:54.940821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:54.941370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:54.941907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:54.942754 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:54.943303 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:54.943788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:55.107800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d79ff6fc-3fa0-4db3-a551-0eb61f99d420 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'create', calling method: .version_select at 0x7f66592924c0>, body: {"keypair": {"name": "tempest-keypair-1205020188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbiBhbM+uVxpO8F4SOngZcypROg0YqO3llNf38fhpKWE/M4lxCKmNiLKYcwUsIEv3ffDo6a/pXUI8tM/4GXuPq6J9265mOPseikEngZGJ29sZGRBdJvi0jkrSIV5rNK2Q=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:55.126205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-d79ff6fc-3fa0-4db3-a551-0eb61f99d420 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:30:55.130868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-d79ff6fc-3fa0-4db3-a551-0eb61f99d420 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for user 461b9a3987744067a62234aaa8d086d0 and project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:30:55.141327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:55.149232 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:55.159198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4b73c30a-76a1-4ce7-9a95-df7ec2e25c5c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.231184 Aug 24 15:30:55.162165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 313/624] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:54 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:55.182834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d79ff6fc-3fa0-4db3-a551-0eb61f99d420 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079109 Aug 24 15:30:55.183835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 312/625] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:30:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:55.317588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:55.318769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:55.328245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:55.330889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:55.331265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:55.332132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:55.337370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:55.338097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:55.543184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:55.562246 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:55.563803 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:55.565021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-170443ec-c084-47bf-b85e-83beb2990ca0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.251713 Aug 24 15:30:55.575261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 314/626] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:55 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:56.183009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:56.184435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:56.190675 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:56.191416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:56.191854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:56.192556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:56.193010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:56.193431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:56.363760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:56.403537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e9811e5d-5d04-4f29-a031-003b0e2d7d8c tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.225214 Aug 24 15:30:56.404566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 313/627] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:56 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:56.592343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:56.592948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:56.599651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:56.600140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:56.600629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:56.611516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:56.612430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:56.612979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:56.996283 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:57.012334 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:57.014103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:57.016219 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0ab81ad9-0662-45e7-abf8-c1c65c39a350 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.429194 Aug 24 15:30:57.017358 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 315/628] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:56 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:57.177377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1865706907", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78a885ba-1e1d-4545-aad6-4c7a1fd937c3"}], "security_groups": [{"name": "tempest-securitygroup--910511050"}], "key_name": "tempest-keypair-1205020188", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:57.298064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] validate_networks() for [('78a885ba-1e1d-4545-aad6-4c7a1fd937c3', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:30:57.427668 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:57.429702 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:57.441978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:57.443034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:57.445435 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:57.446468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:57.449115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:57.449792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:57.652068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:57.662010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7f63a834-0575-47b0-a69a-d932b531cb73 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.238230 Aug 24 15:30:57.664409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 316/629] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:57 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:57.815836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:30:57.816377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:30:57.817371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:30:57.818313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:30:57.818895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:30:57.834433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:57.835549 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:57.836244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:57.837329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:57.838055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:57.838760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:57.865437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:30:57.872656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Getting quotas for user 461b9a3987744067a62234aaa8d086d0 and project ce23bc924f714d72ad20d32a3f5b6d25. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:30:57.888627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:30:57.891272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:30:57.963670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [104df381-731e-4198-8bcb-86f87d5bffbb] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 15:30:58.040708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:58.041622 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:58.049507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:58.050119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:58.050976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:58.052156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:58.052778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:58.053375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:58.227084 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:58.238350 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:58.240325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:58.241974 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0c8986ca-2e51-4e9a-82c7-0450a6d1f274 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.205449 Aug 24 15:30:58.242907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 317/630] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:58 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:58.686704 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:58.688051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:58.702845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:58.703374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:58.703825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:58.704826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:58.705329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:58.705836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:58.903596 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:58.907855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:58.916614 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e9b7abaa-4e4a-41e1-9eed-c6446393a477 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.233950 Aug 24 15:30:58.917355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 318/631] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:58 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:30:58.922211 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-9f497491-8f43-4993-9458-fd52445de9f1 req-050f757a-787a-4c3e-8fbd-331e9f39591c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0ccb78-7647-4852-97e6-65c22d4637d3", "name": "network-vif-plugged", "status": "completed", "tag": "da5494c3-1aed-4b57-8a4d-033c8c666fd9"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:30:58.935960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-9f497491-8f43-4993-9458-fd52445de9f1 req-050f757a-787a-4c3e-8fbd-331e9f39591c service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:58.936558 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-9f497491-8f43-4993-9458-fd52445de9f1 req-050f757a-787a-4c3e-8fbd-331e9f39591c service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:58.937281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-9f497491-8f43-4993-9458-fd52445de9f1 req-050f757a-787a-4c3e-8fbd-331e9f39591c service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:58.949519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-9f497491-8f43-4993-9458-fd52445de9f1 req-050f757a-787a-4c3e-8fbd-331e9f39591c service nova] Creating event network-vif-plugged:da5494c3-1aed-4b57-8a4d-033c8c666fd9 for instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 on hv-cinder-84890 Aug 24 15:30:58.954984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-9f497491-8f43-4993-9458-fd52445de9f1 req-050f757a-787a-4c3e-8fbd-331e9f39591c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Aug 24 15:30:58.955695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 319/632] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:30:58.979577 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [104df381-731e-4198-8bcb-86f87d5bffbb] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 58272. Aug 24 15:30:58.988695 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f58ff2a4-1690-45ed-9c24-bf735779145c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.815492 Aug 24 15:30:58.990702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 314/633] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:30:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:30:59.023780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9007d511-8b03-412d-9e84-cbe91756bb2d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:59.024681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9007d511-8b03-412d-9e84-cbe91756bb2d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:59.090629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=4 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:59.127811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9007d511-8b03-412d-9e84-cbe91756bb2d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:59.137953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9007d511-8b03-412d-9e84-cbe91756bb2d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1246 microversion: 2.1 time: 0.132117 Aug 24 15:30:59.139098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 320/634] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:59 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1246 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:30:59.266871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:59.268190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:59.283505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:59.284202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:59.284658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:59.286274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:59.287063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:59.287510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:59.459493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:59.462275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:30:59.473441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:59.477531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:30:59.480162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-448b10fd-5360-47cd-be00-c1662238459d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.218280 Aug 24 15:30:59.482129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 315/635] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:30:59 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:30:59.943329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:30:59.944043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:30:59.952821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:59.953703 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:59.954442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:30:59.956160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:30:59.956160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:30:59.956376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:00.149021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:00.163311 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5b661120-ae2b-4013-b630-189de675ab06 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.224106 Aug 24 15:31:00.164763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:00.165972 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:00.178860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 321/636] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:30:59 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:00.187000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:00.187794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:00.188533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:00.189704 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:00.190370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:00.191231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:00.296337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:00.307482 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b2e8645c-48e4-4a26-883f-e8eda3e703e4 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1242 microversion: 2.1 time: 0.146533 Aug 24 15:31:00.309262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 316/637] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:00 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:00.508527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:00.509060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:00.517276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:00.517762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:00.518191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:00.518915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:00.519535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:00.520114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:00.704552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:00.714575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:00.716062 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:00.717229 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7dd1ef4c-e158-4820-a0b8-255460798eaf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.213333 Aug 24 15:31:00.717774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 322/638] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:00 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:01.185095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:01.185710 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:01.192367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:01.193018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:01.193481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:01.194382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:01.194930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:01.195352 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:01.327616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:01.330366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:01.330984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:01.336429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7bd084ea-6980-46f4-a362-b7ed7fa4064e tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1319 microversion: 2.1 time: 0.155096 Aug 24 15:31:01.337005 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 317/639] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:01 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:01.338037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:01.338554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:01.338986 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:01.339784 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:01.340242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:01.340672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:01.402052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:01.410100 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4e6f79ec-2903-4677-8b72-39a75e33297f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1298 microversion: 2.1 time: 0.083494 Aug 24 15:31:01.411231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 323/640] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:01 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:01.740984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:01.742187 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:01.748179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:01.748658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:01.749092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:01.749786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:01.750256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:01.750879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:01.888092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:01.898151 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:01.899870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:01.901326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a942b683-bab1-43ab-9be6-ecad85c89587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.164213 Aug 24 15:31:01.901964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 318/641] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:01 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:02.358356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:02.358874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:02.365440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.365916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.366960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.367687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.368199 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.368623 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.431580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:02.433065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:02.439986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.440601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.441300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.442092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.442845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.443357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.514300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:02.522568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:02.523619 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f191c608-f44c-458e-b1a3-a8d3b74f1d24 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1508 microversion: 2.1 time: 0.169319 Aug 24 15:31:02.524391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 324/642] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:02 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:02.530659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-383fcdfe-ae1e-4f1f-af92-8409de79e12e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1298 microversion: 2.1 time: 0.103822 Aug 24 15:31:02.531677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 319/643] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:02 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:02.545373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "159fa6d4-cf8d-4853-b71e-3e75d78482cf", "device": "/dev/sdb"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:02.548359 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:02.554983 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.555442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.555864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.556557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.557002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.557418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.924949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:02.925544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:02.931435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.931912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.932342 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:02.933014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:02.933458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:02.933873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:03.060083 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:03.068077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:03.070077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:03.071265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3df36aa5-b1ee-4fad-912e-27113ad9ecf3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.150165 Aug 24 15:31:03.071799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 320/644] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:02 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:03.552255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:03.552925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:03.559927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:03.560404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:03.560832 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:03.561533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:03.561965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:03.562411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:03.624686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:03.632903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-29627f97-97b8-4681-baad-a96304c54d13 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1306 microversion: 2.1 time: 0.084037 Aug 24 15:31:03.633463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 321/645] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:03 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:04.094350 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:04.095672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:04.102496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:04.103313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:04.103969 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:04.104907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:04.105628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:04.106336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:04.158597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7172685d-7f2f-4a72-9cce-451b82df5df7 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "POST /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.617055 Aug 24 15:31:04.160039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 325/646] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:31:02 2022] POST /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3/os-volume_attachments => generated 194 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:04.344915 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:04.353802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:04.356530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:04.358063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-32dd1399-57f3-4575-9ccd-fd7e24b0ad00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.267799 Aug 24 15:31:04.374139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 322/647] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:04 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:04.596392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:04.597550 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:04.604997 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:04.606004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:04.606696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:04.607476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:04.608027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:04.608515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:04.662310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:04.663897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:04.670681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:04.671796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:04.672338 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:04.673165 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:04.673697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:04.676884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:04.804127 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:04.808615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:04.814791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-984835c2-6720-4ea3-a178-2dc943f9202d tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1594 microversion: 2.1 time: 0.224347 Aug 24 15:31:04.815493 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 326/648] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:04 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1594 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:04.836002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c974ec47-faeb-4c80-9aa5-a01f8226cfc7 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1304 microversion: 2.1 time: 0.184316 Aug 24 15:31:04.836674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 323/649] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:04 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:05.382417 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:05.383318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:05.390356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:05.390845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:05.391285 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:05.391999 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:05.392447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:05.393157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:05.656231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:05.665316 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:05.666848 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:05.668521 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-39e60d67-e954-4d75-97c1-0485e6a5a960 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.291106 Aug 24 15:31:05.669075 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 327/650] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:05 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:05.857999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:05.859008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:05.869881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:05.872062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:05.873259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:05.874040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:05.874757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:05.875160 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:06.088132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-fe1877f4-f549-46a7-84dc-592aae89b249 req-d54aaf8c-8a29-4ff0-b54f-2c8128b66b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0867b09-cad0-497b-b0ec-15092faf6e1c", "tag": "922a4b3f-f7ee-436d-8411-f2e3508ed3d3"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:06.102641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-fe1877f4-f549-46a7-84dc-592aae89b249 req-d54aaf8c-8a29-4ff0-b54f-2c8128b66b51 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:06.103416 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-fe1877f4-f549-46a7-84dc-592aae89b249 req-d54aaf8c-8a29-4ff0-b54f-2c8128b66b51 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:06.104052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-fe1877f4-f549-46a7-84dc-592aae89b249 req-d54aaf8c-8a29-4ff0-b54f-2c8128b66b51 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:06.123626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-fe1877f4-f549-46a7-84dc-592aae89b249 req-d54aaf8c-8a29-4ff0-b54f-2c8128b66b51 service nova] Creating event network-changed:922a4b3f-f7ee-436d-8411-f2e3508ed3d3 for instance c0867b09-cad0-497b-b0ec-15092faf6e1c on hv-cinder-84890 Aug 24 15:31:06.138871 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-fe1877f4-f549-46a7-84dc-592aae89b249 req-d54aaf8c-8a29-4ff0-b54f-2c8128b66b51 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057787 Aug 24 15:31:06.140095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 328/651] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:31:06.240042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:06.248132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-60f31336-514a-4ea7-b56a-6af9b902348c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.393914 Aug 24 15:31:06.249029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 324/652] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:05 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:06.689183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-893ecddb-d975-47da-b65c-6f5786b96808 req-70baaa43-9477-4e90-ab8e-629184fc91eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "name": "network-vif-plugged", "status": "completed", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:06.695752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:06.699296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:06.700245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:06.702592 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-893ecddb-d975-47da-b65c-6f5786b96808 req-70baaa43-9477-4e90-ab8e-629184fc91eb service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:06.703515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-893ecddb-d975-47da-b65c-6f5786b96808 req-70baaa43-9477-4e90-ab8e-629184fc91eb service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:06.704208 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-893ecddb-d975-47da-b65c-6f5786b96808 req-70baaa43-9477-4e90-ab8e-629184fc91eb service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:06.707934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:06.708436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:06.709032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:06.710900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:06.711812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:06.712570 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:06.719528 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-893ecddb-d975-47da-b65c-6f5786b96808 req-70baaa43-9477-4e90-ab8e-629184fc91eb service nova] Creating event network-vif-plugged:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:31:06.728207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-893ecddb-d975-47da-b65c-6f5786b96808 req-70baaa43-9477-4e90-ab8e-629184fc91eb service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051077 Aug 24 15:31:06.729450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 329/653] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:06.876501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:06.885081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:06.886611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:06.887905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c3248af4-a2d1-47a6-bcb7-2b9e04e5e134 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.199049 Aug 24 15:31:06.888464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 325/654] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:06 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:07.269892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:07.270690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:07.278783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:07.279948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:07.279948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:07.280394 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:07.280843 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:07.281255 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:07.372996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-79114f09-8b7e-4984-8d2e-73df02bec96d req-6f8a32a1-8e64-4a4e-8609-77e78095028f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:07.388951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-79114f09-8b7e-4984-8d2e-73df02bec96d req-6f8a32a1-8e64-4a4e-8609-77e78095028f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:07.389708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-79114f09-8b7e-4984-8d2e-73df02bec96d req-6f8a32a1-8e64-4a4e-8609-77e78095028f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:07.390412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-79114f09-8b7e-4984-8d2e-73df02bec96d req-6f8a32a1-8e64-4a4e-8609-77e78095028f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:07.403377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-79114f09-8b7e-4984-8d2e-73df02bec96d req-6f8a32a1-8e64-4a4e-8609-77e78095028f service nova] Creating event network-changed:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:31:07.409739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-79114f09-8b7e-4984-8d2e-73df02bec96d req-6f8a32a1-8e64-4a4e-8609-77e78095028f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040135 Aug 24 15:31:07.410649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 326/655] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:31:07.454269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:07.473363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-15673e39-095a-4285-8e5a-79a7bf64557b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.207971 Aug 24 15:31:07.479211 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 330/656] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:07 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:07.909097 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:07.911330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=10 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:07.921219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:07.922519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:07.931223 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:07.931612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:07.932042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:07.932738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:07.933184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:07.933602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:08.129775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:08.139745 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:08.141494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:08.143056 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-39336d0b-cb23-44c2-b190-5220c3610881 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.235348 Aug 24 15:31:08.143864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 327/657] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:07 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:08.451822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1793632787"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:08.453235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:08.462580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:08.463220 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:08.463678 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:08.464415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:08.464876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:08.465317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:08.495264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:08.495988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:08.502242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:08.503392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:08.507374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:08.508506 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:08.508971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:08.509397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:08.653647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.network.security_group_api [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Adding security group d2070089-b818-4782-bad8-c0187230d41a to port e8b0b45d-ec97-4a0f-bf7e-2ef583da561a Aug 24 15:31:08.689979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:08.700757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-250fee38-6402-4973-82ac-cccc0b967aed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.209843 Aug 24 15:31:08.702285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 328/658] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:08 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:08.987115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-474fc68e-c827-4392-adc6-70c51e9450a8 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/action" status: 202 len: 0 microversion: 2.1 time: 0.539317 Aug 24 15:31:08.988078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 331/659] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:31:08 2022] POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:31:08.997141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:08.997752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:09.004585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.005062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.005758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.006977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.007422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.008003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.164670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:09.166995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:09.169227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:09.170271 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:09.175646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-397d54d3-4dd8-4675-9dab-c1e6ec502f27 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1641 microversion: 2.1 time: 0.182655 Aug 24 15:31:09.176222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 329/660] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:08 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1641 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:09.177464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.177947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.178977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.179734 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.180328 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.180753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.329613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:09.338266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:09.339770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:09.340917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-56786f81-69e0-43b5-9944-6d37fa98816a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.178410 Aug 24 15:31:09.341475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 332/661] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:09 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:09.427670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-74f90524-9595-4ce6-bfc5-9d15013a24ee req-1852a6cc-1fad-459c-8115-e9b60543f405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:09.438014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-74f90524-9595-4ce6-bfc5-9d15013a24ee req-1852a6cc-1fad-459c-8115-e9b60543f405 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.438504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-74f90524-9595-4ce6-bfc5-9d15013a24ee req-1852a6cc-1fad-459c-8115-e9b60543f405 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.438957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-74f90524-9595-4ce6-bfc5-9d15013a24ee req-1852a6cc-1fad-459c-8115-e9b60543f405 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.451508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-74f90524-9595-4ce6-bfc5-9d15013a24ee req-1852a6cc-1fad-459c-8115-e9b60543f405 service nova] Creating event network-changed:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:31:09.457075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-74f90524-9595-4ce6-bfc5-9d15013a24ee req-1852a6cc-1fad-459c-8115-e9b60543f405 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032893 Aug 24 15:31:09.457668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 330/662] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:09.723555 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:09.724172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:09.731036 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.731519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.731987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.732679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:09.733136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:09.733562 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:09.876228 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:09.883796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-830538b5-a4a0-47b2-85d8-7b3068ee9689 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.164133 Aug 24 15:31:09.884350 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 333/663] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:09 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:10.364628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:10.365318 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:10.371403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:10.371882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:10.372309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:10.372988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:10.373430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:10.373856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:10.517953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:10.527620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:10.529108 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:10.530569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-970613be-0f93-431c-a0bd-0bc6c087a553 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.170646 Aug 24 15:31:10.543053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 331/664] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:10 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:10.903934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:10.904565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:10.911152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:10.911620 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:10.912095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:10.912761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:10.913207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:10.913624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:11.051705 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:11.059921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-aaaf7291-04bd-47d8-ae0b-ed99fdbb35a3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.159904 Aug 24 15:31:11.060486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 334/665] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:10 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:11.555755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:11.556358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:11.562780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:11.563294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:11.563720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:11.564404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:11.564851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:11.565273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:11.697851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:11.706527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:11.708016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:11.709171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5136883e-52a7-40bf-81c4-44c12c838e60 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.157882 Aug 24 15:31:11.710251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 332/666] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:11 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:12.080900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:12.081508 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:12.088596 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:12.089078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:12.089510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:12.090198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:12.090846 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:12.091261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:12.321264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:12.337317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cbea7efd-dfe6-4fcc-b9d9-5b5de3c45412 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.260045 Aug 24 15:31:12.338131 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 335/667] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:12 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:12.733093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:12.733711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:12.740225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:12.740752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:12.741405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:12.742307 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:12.742762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:12.743357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:12.898496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:12.900638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:12.909106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:12.910700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:12.912137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f9afd139-3943-4a63-a552-9ef4667f4462 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.183104 Aug 24 15:31:12.913051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 333/668] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:12 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:13.358109 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:13.358765 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:13.365376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:13.366209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:13.366860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:13.367823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:13.368573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:13.370619 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:13.513098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:13.520920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e4717e23-878a-4c01-afbc-00e8fe83b461 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.166664 Aug 24 15:31:13.521482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 336/669] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:13 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:13.935889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:13.936485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:13.943028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:13.943505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:13.944567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:13.945246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:13.945695 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:13.946141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:14.090433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:14.101046 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:14.102819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:14.104096 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-99f85bc5-f791-4e01-8e4e-d7b578dbf3b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.172048 Aug 24 15:31:14.104644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 334/670] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:13 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:14.541618 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:14.542247 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:14.548937 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:14.549421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:14.549857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:14.550873 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:14.551336 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:14.551850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:14.572022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:14.693510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:14.701657 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3663bd33-9506-4794-b599-77ddd7c7f6a0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.163751 Aug 24 15:31:14.702245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 337/671] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:14 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:15.127167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:15.127804 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:15.134369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:15.134850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:15.135282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:15.135962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:15.136415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:15.136836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:15.261565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:15.269785 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:15.271289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:15.272469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-23512149-1ef9-400e-a6ab-54a88f33b11c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.149104 Aug 24 15:31:15.273016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 335/672] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:15 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:15.722030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:15.722662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:15.729637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:15.730117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:15.730582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:15.731267 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:15.731721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:15.732144 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:15.860602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:15.868816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-09cb2b02-4038-4990-9027-3ec5aded956c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.150587 Aug 24 15:31:15.869378 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 338/673] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:15 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:16.295889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:16.296533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:16.302910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:16.303898 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:16.304325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:16.305038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:16.305485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:16.305904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:16.435281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:16.443339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:16.445389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:16.446558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-32ee824f-9e3c-44fd-a996-7f69307467b4 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.154571 Aug 24 15:31:16.447122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 336/674] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:16 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:16.889467 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:16.890074 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:16.896579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:16.897508 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:16.897939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:16.898655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:16.899108 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:16.899531 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:17.031709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:17.039701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f460a890-98c9-43b1-a28f-b40c2ab44997 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.154125 Aug 24 15:31:17.040271 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 339/675] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:16 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:17.468973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:17.469559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:17.476627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:17.477100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:17.477529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:17.478252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:17.478686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:17.479111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:17.611494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:17.619613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:17.621090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:17.622240 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-89566072-1158-4fd1-8899-31760711354a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.157148 Aug 24 15:31:17.622795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 337/676] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:17 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:18.060626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:18.061157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:18.067760 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:18.068247 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:18.069194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:18.069891 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:18.070386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:18.070816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:18.207219 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:18.215938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b6dbf5df-b409-43c8-9c74-98063a847eb8 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.159422 Aug 24 15:31:18.216493 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 340/677] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:18 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:18.645598 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:18.646265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:18.653387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:18.653858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:18.654325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:18.655016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:18.655554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:18.656226 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:18.792944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:18.801199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:18.802823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:18.804677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-70a8731e-1484-4bc3-8d92-fe01b919bfea tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.163004 Aug 24 15:31:18.805282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 338/678] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:18 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:19.235716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:19.236266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:19.243243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:19.243723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:19.244162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:19.244851 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:19.245313 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:19.245712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:19.376049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:19.387204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-80a00466-86e7-4730-9303-d044d3f82873 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.155421 Aug 24 15:31:19.387781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 341/679] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:19 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:19.828378 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:19.828995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:19.835909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:19.836389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:19.836823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:19.837527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:19.838016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:19.838488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:19.973098 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:19.981997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:19.983528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:19.984791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f4e13036-2a39-4fc4-bf35-8dfc639d7af0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.160239 Aug 24 15:31:19.985230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 339/680] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:19 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:20.407777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:20.408646 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:20.415673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:20.416160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:20.416597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:20.417291 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:20.417746 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:20.418170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:20.560867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:20.568629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-790a733a-2ae0-40f5-8c1b-571bef027ca0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.164727 Aug 24 15:31:20.569195 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 342/681] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:20 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:21.008819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:21.009539 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:21.016155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:21.016669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:21.017105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:21.017799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:21.018283 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:21.018709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:21.166916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:21.178963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:21.180538 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:21.181700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bbe0bbe8-f948-438c-822a-2c08df6fb652 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.178142 Aug 24 15:31:21.182264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 340/682] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:21 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:21.589495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:21.590103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:21.596721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:21.597202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:21.597639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:21.598368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:21.598824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:21.599251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:21.729863 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:21.737612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ff37b046-7388-4cb3-b4e7-f9a4caa73cd1 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.152018 Aug 24 15:31:21.738179 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 343/683] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:21 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:22.204695 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:22.205270 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:22.212377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:22.212888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:22.213321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:22.214006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:22.214480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:22.214914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:22.347552 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:22.356038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:22.357523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:22.358716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6af7e97a-7e58-41d8-a2aa-41fbe485144c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.158125 Aug 24 15:31:22.359285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 341/684] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:22 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:22.758812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:22.759430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:22.765836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:22.766359 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:22.766801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:22.767499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:22.767961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:22.768390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:22.904196 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:22.912819 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ec788cc9-e48e-4217-8eb6-ca901d9304bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.158441 Aug 24 15:31:22.913389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 344/685] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:22 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:23.382556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:23.383167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:23.389596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:23.390074 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:23.390547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:23.391242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:23.391698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:23.392120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:23.521338 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:23.529710 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:23.531232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:23.532398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ab7b2784-a46d-4af0-b4d1-b401e8b1f016 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1747 microversion: 2.20 time: 0.153828 Aug 24 15:31:23.532999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 342/686] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:23 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:23.780023 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-0a3ad07b-0c99-4c7f-8138-e17c78c20166 req-c7beaebe-5e40-405b-840a-0bb6cf8452f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0867b09-cad0-497b-b0ec-15092faf6e1c", "name": "network-vif-plugged", "status": "completed", "tag": "922a4b3f-f7ee-436d-8411-f2e3508ed3d3"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:23.791721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-0a3ad07b-0c99-4c7f-8138-e17c78c20166 req-c7beaebe-5e40-405b-840a-0bb6cf8452f8 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:23.792200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-0a3ad07b-0c99-4c7f-8138-e17c78c20166 req-c7beaebe-5e40-405b-840a-0bb6cf8452f8 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:23.792630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-0a3ad07b-0c99-4c7f-8138-e17c78c20166 req-c7beaebe-5e40-405b-840a-0bb6cf8452f8 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:23.804425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-0a3ad07b-0c99-4c7f-8138-e17c78c20166 req-c7beaebe-5e40-405b-840a-0bb6cf8452f8 service nova] Creating event network-vif-plugged:922a4b3f-f7ee-436d-8411-f2e3508ed3d3 for instance c0867b09-cad0-497b-b0ec-15092faf6e1c on hv-cinder-84890 Aug 24 15:31:23.809603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-0a3ad07b-0c99-4c7f-8138-e17c78c20166 req-c7beaebe-5e40-405b-840a-0bb6cf8452f8 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033256 Aug 24 15:31:23.810184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 345/687] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:23.933493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:23.934873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:23.941579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:23.941579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:23.941913 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:23.942655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:23.943110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:23.944090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:24.116367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:24.124711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f9d7b2c9-0182-4c27-970c-d89f9f6c55e3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.195010 Aug 24 15:31:24.125290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 343/688] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:23 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:24.557230 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:24.558124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:24.565229 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:24.565753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:24.566411 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:24.567137 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:24.567684 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:24.568249 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:24.723035 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:24.731285 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:24.733019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:24.734186 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b9985f0e-f0e9-49ed-86c2-2235ba54db45 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.181926 Aug 24 15:31:24.734842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 346/689] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:24 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:25.144890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:25.145766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:25.153191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:25.153767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:25.154470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:25.155366 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:25.156152 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:25.156620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:25.309387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:25.318800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d9042c17-ec75-4d11-8108-410b0dd84c18 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.177534 Aug 24 15:31:25.319688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 344/690] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:25 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:25.763856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:25.764490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:25.771863 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:25.772771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:25.773214 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:25.773933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:25.774423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:25.775047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:25.936902 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:25.946851 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:25.949034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:25.949936 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2de82fd8-604b-40b4-807f-d2610bedcc8a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.190334 Aug 24 15:31:25.950530 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 347/691] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:25 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:26.340919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:26.341551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:26.343988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:26.349947 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:26.351031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:26.351031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:26.354361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:26.354361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:26.354361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:26.954316 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:26.962157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a5d54b33-837d-429b-8bb1-0a47f7c19eed tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.625364 Aug 24 15:31:26.962760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 345/692] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:26 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:26.977380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:26.978380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:26.985380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:26.985862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:26.986333 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:26.987067 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:26.987518 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:26.987940 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:27.219035 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:27.229831 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:27.231661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:27.232834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-92a024d2-e57d-4b5d-8d9c-c0bcc1deb2c1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.260565 Aug 24 15:31:27.233386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 348/693] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:26 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:27.987066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:27.987899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:27.995897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:27.996380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:27.996831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:27.997558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:27.998001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:27.998522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:28.156494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:28.164564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7db8b8bc-272b-4732-9df8-c806c72efe68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.181485 Aug 24 15:31:28.165141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 346/694] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:27 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:28.259068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:28.259673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:28.266725 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:28.267521 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:28.267953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:28.268848 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:28.269497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:28.270090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:28.450735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:28.459088 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:28.460595 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:28.463377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-edeca959-b4ba-42cf-a880-21a53e4c267b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.207379 Aug 24 15:31:28.463377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 349/695] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:28 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:29.185882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:29.186829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:29.195926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:29.196896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:29.197905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:29.199009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:29.199961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:29.200730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:29.371917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:29.380587 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-29dfbafd-f7a8-488e-b93d-5e8f08f5bb47 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.198928 Aug 24 15:31:29.405707 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 347/696] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:29 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:29.487982 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:29.489806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:29.499535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:29.500339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:29.500918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:29.501927 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:29.502819 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:29.503389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:29.704403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:29.725347 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:29.726884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:29.734940 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5a0fc772-c5d2-4487-9778-5bb7b0b54c1f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.252516 Aug 24 15:31:29.742157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 350/697] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:29 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:30.410619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:30.411534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:30.421387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:30.422208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:30.423018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:30.424621 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:30.425295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:30.426010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:30.607369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:30.616967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8c992bd4-14d1-449b-bd46-785ed7fd2480 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.213588 Aug 24 15:31:30.617932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 348/698] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:30 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:30.764143 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:30.764766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:30.772498 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:30.772993 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:30.773431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:30.774143 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:30.774629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:30.775056 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:30.953857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:30.963905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:30.965727 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:30.968962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a66cc28b-4e2c-43b8-a142-3e61fe9fa49a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.210979 Aug 24 15:31:30.969552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 351/699] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:30 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:31.637396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:31.638019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:31.644728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:31.645928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:31.645928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:31.647356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:31.647356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:31.647356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:31.807423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:31.816448 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-798cd20c-5fb7-4f8a-9827-f391bdbbf81c tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.183133 Aug 24 15:31:31.816878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 349/700] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:31 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:31.993692 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:31.994990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:32.002302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:32.003392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:32.003962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:32.004877 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:32.005480 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:32.006723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:32.161972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:32.171927 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:32.174346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:32.176101 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bf5a8b1d-e33b-4122-9893-eb11961fc973 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.186740 Aug 24 15:31:32.177090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 352/701] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:31 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:32.838645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:32.839931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:32.847078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:32.847761 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:32.848305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:32.849162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:32.850946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:32.851496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:32.873071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:33.025128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:33.036052 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-83b73b5b-3d35-4672-b30f-24c6e71ed91e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1371 microversion: 2.1 time: 0.202255 Aug 24 15:31:33.036640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 350/702] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:32 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:33.336263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:33.336881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:33.344519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:33.345004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:33.345443 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:33.346154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:33.346712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:33.347347 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:33.517312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:33.528191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:33.531540 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:33.532898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7f13c358-f2cf-44c5-8b13-7474312176cd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.336433 Aug 24 15:31:33.534126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 353/703] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:33 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:34.057617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:34.058842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:34.070838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:34.071629 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:34.072062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:34.072763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:34.073206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:34.073623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:34.255008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:34.266720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6cee7a07-369b-4554-a5b9-fde19d519d51 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1565 microversion: 2.1 time: 0.212963 Aug 24 15:31:34.267555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 351/704] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:34 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:34.290667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:34.291489 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:34.298544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:34.299045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:34.299499 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:34.300224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:34.300693 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:34.301126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:34.436085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1ed10e3a-ae74-446a-9164-0cd37c4e27c5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150136 Aug 24 15:31:34.436665 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 354/705] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:31:34 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:34.571280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:34.571901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:34.591547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:34.592063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:34.592495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:34.593212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:34.593690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:34.594717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:34.785580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:34.801645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:34.804054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:34.807068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b3057e3b-2a29-46da-8316-1cdcdb84d9b3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.240199 Aug 24 15:31:34.809360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 352/706] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:34 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:35.816265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-d09a043d-39b2-4cdf-af15-a86c6230fdee req-b6d9b32e-2311-4467-9ab7-3acf81b7cbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0867b09-cad0-497b-b0ec-15092faf6e1c", "tag": "922a4b3f-f7ee-436d-8411-f2e3508ed3d3"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:35.828327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d09a043d-39b2-4cdf-af15-a86c6230fdee req-b6d9b32e-2311-4467-9ab7-3acf81b7cbc3 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:35.828820 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d09a043d-39b2-4cdf-af15-a86c6230fdee req-b6d9b32e-2311-4467-9ab7-3acf81b7cbc3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:35.829255 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d09a043d-39b2-4cdf-af15-a86c6230fdee req-b6d9b32e-2311-4467-9ab7-3acf81b7cbc3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:35.835208 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:35.843832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-d09a043d-39b2-4cdf-af15-a86c6230fdee req-b6d9b32e-2311-4467-9ab7-3acf81b7cbc3 service nova] Creating event network-changed:922a4b3f-f7ee-436d-8411-f2e3508ed3d3 for instance c0867b09-cad0-497b-b0ec-15092faf6e1c on hv-cinder-84890 Aug 24 15:31:35.845563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:35.847435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:35.850375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-d09a043d-39b2-4cdf-af15-a86c6230fdee req-b6d9b32e-2311-4467-9ab7-3acf81b7cbc3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038062 Aug 24 15:31:35.851315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 355/707] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:35.856787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:35.857623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:35.858331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:35.859257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:35.859773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:35.860261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:36.016886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:36.025834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:36.027395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:36.028565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a56256bb-abfc-46d0-870f-df98c99f9cfa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.187767 Aug 24 15:31:36.029124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 353/708] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:35 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:37.054573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:37.055153 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:37.057036 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=54 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:37.062832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:37.063313 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:37.063743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:37.064444 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:37.064890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:37.065306 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:37.203433 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:37.211586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:37.213078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:37.214249 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0107e7b9-27db-4bb6-9cce-7fa1b4180a17 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1742 microversion: 2.20 time: 0.165240 Aug 24 15:31:37.214806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 356/709] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:37 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:31:37.269907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:37.270571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:37.277705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:37.278192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:37.278660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:37.279556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:37.280013 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:37.281077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:37.363686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lazy-loading 'services' on Instance uuid 1e0ccb78-7647-4852-97e6-65c22d4637d3 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:31:37.440432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ae64700a-d525-4e62-9db8-ea432cefd05f tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3/os-volume_attachments/159fa6d4-cf8d-4853-b71e-3e75d78482cf" status: 202 len: 0 microversion: 2.1 time: 0.174220 Aug 24 15:31:37.441023 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 354/710] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:31:37 2022] DELETE /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3/os-volume_attachments/159fa6d4-cf8d-4853-b71e-3e75d78482cf => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:31:38.237808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:38.238366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:38.248731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:38.249137 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:38.249919 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:38.250860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:38.251227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:38.251559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:38.406210 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:38.415601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:38.417081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:38.418244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7a2938e8-48a4-4b0f-82a0-5edef52a9aa3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1724 microversion: 2.20 time: 0.185164 Aug 24 15:31:38.418794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 357/711] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:38 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:39.443507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:39.444206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:39.450355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.450828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.451256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.451934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.452384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.452802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.588701 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:39.596572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:39.598028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:39.599225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d6968071-9989-4bef-a800-55a106391d85 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1724 microversion: 2.20 time: 0.161223 Aug 24 15:31:39.599778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 355/712] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:39 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:39.628784 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:39.629317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:39.636437 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.636912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.637340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.638028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.638510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.638932 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.665674 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:31:39.743440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dc30caf6-e55a-41fd-8949-8cdd24b22a78 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "DELETE /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 204 len: 0 microversion: 2.1 time: 0.120357 Aug 24 15:31:39.744026 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 358/713] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:31:39 2022] DELETE /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:39.753103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:39.753802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:39.760495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.761053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.761560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.762357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.762996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.763585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.779939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-b119d92f-fbd4-45ba-9723-bbb0a0b25d8a req-571d019f-0118-4444-9da8-b23131b462c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "name": "network-vif-unplugged", "status": "completed", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:39.790053 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-b119d92f-fbd4-45ba-9723-bbb0a0b25d8a req-571d019f-0118-4444-9da8-b23131b462c3 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:39.790630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-b119d92f-fbd4-45ba-9723-bbb0a0b25d8a req-571d019f-0118-4444-9da8-b23131b462c3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:39.791124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-b119d92f-fbd4-45ba-9723-bbb0a0b25d8a req-571d019f-0118-4444-9da8-b23131b462c3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:39.808099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-b119d92f-fbd4-45ba-9723-bbb0a0b25d8a req-571d019f-0118-4444-9da8-b23131b462c3 service nova] Creating event network-vif-unplugged:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:31:39.814085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-b119d92f-fbd4-45ba-9723-bbb0a0b25d8a req-571d019f-0118-4444-9da8-b23131b462c3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039910 Aug 24 15:31:39.814728 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 359/714] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:39.897393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:39.905242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-91e85db3-5614-44bf-9379-78b06b165a0b tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.156583 Aug 24 15:31:39.905812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 356/715] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:39 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:40.623604 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:40.624302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:40.630453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:40.631043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:40.631345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:40.632027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:40.632487 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:40.632909 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:40.761801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:40.770054 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:40.771579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:40.772719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d09508ec-756f-46c7-aede-de8acbf6b97e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1724 microversion: 2.20 time: 0.153383 Aug 24 15:31:40.773263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 360/716] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:40 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:40.926119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:40.926806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:40.933631 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:40.934101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:40.934566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:40.935237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:40.935676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:40.936092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:41.065232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:41.073397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5c6dc956-eaf0-41fe-bed5-248b07473524 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.151133 Aug 24 15:31:41.073973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 357/717] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:40 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:41.796413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:41.797044 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:41.804011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:41.804482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:41.804910 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:41.805588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:41.806040 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:41.806482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:41.938619 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:41.947182 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:41.948630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:41.949761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a6e83128-bab2-458b-9525-d0dc5fd65a69 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1724 microversion: 2.20 time: 0.157273 Aug 24 15:31:41.950327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 361/718] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:41 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:42.093311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:42.093847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:42.100724 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:42.101194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:42.101622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:42.102325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:42.102775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:42.103194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:42.232103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:42.239635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-edb658f1-853e-4ed6-96b8-b7a0dcee74cc tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.150207 Aug 24 15:31:42.240728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 358/719] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:42 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:42.972334 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:42.972951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:42.979767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:42.980249 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:42.980685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:42.981378 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:42.981834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:42.982288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:43.110406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:43.119089 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:43.120765 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:43.122330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2a4cd0d4-0685-40e6-9fdf-fc79075c1a5d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1724 microversion: 2.20 time: 0.153776 Aug 24 15:31:43.122894 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 362/720] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:42 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:43.261698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:43.262325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:43.268630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:43.269104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:43.269527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:43.270203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:43.270768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:43.271192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:43.406141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:43.414607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-91af7365-0a61-4688-a42d-3153a8384076 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.156738 Aug 24 15:31:43.415161 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 359/721] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:43 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:44.145787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:44.146452 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:44.153853 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:44.154372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:44.154815 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:44.155505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:44.155969 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:44.156387 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:44.290495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:44.298538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:44.300029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:44.301170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7aaf2aac-5ed4-4600-aff8-a8bec7dd9942 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1724 microversion: 2.20 time: 0.159285 Aug 24 15:31:44.301730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 363/722] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:44 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:44.435753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:44.436357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:44.442765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:44.443244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:44.443669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:44.444347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:44.444790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:44.445205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:44.574363 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:44.582045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-15234021-6ccd-4185-8355-509b1edcc930 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.150084 Aug 24 15:31:44.582812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 360/723] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:44 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:45.325042 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:45.325587 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:45.332482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.333376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.334647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.335728 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.336544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.337238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.469019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:45.477687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:45.479249 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:45.480402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2e364c9d-75ac-41e9-ab65-fe6e65059dab tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1727 microversion: 2.20 time: 0.159423 Aug 24 15:31:45.480955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 364/724] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:45 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:45.502743 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d61ac1f5-f8ee-43b6-9c4e-86c2c0257c67"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:45.505129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:45.512175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.512651 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.513080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.513773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.514281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.514709 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.603524 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:45.604372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:45.610814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.611300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.611734 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.618973 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.619458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.620096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.760648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:45.768905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8e86c8a6-4955-452f-91db-c4e19a777da3 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.169592 Aug 24 15:31:45.769731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 365/725] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:45 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:31:45.803525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e3fe979a-3f6b-4cff-8c56-e846752fb62e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304666 Aug 24 15:31:45.804118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 361/726] 10.222.0.76 () {62 vars in 1364 bytes} [Wed Aug 24 15:31:45 2022] POST /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:31:45.924713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:45.925300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:45.931156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.931625 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.932053 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.932727 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:45.933173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:45.933589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:45.976052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120848) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:31:46.044117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-224f3000-9a40-4d10-ad95-521ae9508cbd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/action" status: 202 len: 0 microversion: 2.20 time: 0.123065 Aug 24 15:31:46.044784 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 366/727] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 15:31:45 2022] POST /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:31:46.053197 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:46.053810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:46.060752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:46.061437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:46.062031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:46.062967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:46.063594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:46.064171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:46.195671 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:46.204487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:46.205967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:46.207147 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-084107bb-2d99-47af-8c8c-428ebd3cdc3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1753 microversion: 2.20 time: 0.158391 Aug 24 15:31:46.210608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 362/728] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:46 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:46.792110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:46.792591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:46.798819 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:46.799300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:46.799736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:46.800552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:46.800953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:46.801538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:46.942950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22c5f040350d4daba0ebe2af86849a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00071111c84346639e5245e5c173dad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:46.951107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-32079d5f-b6a1-40de-8d77-5b8136112702 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 200 len: 1514 microversion: 2.1 time: 0.164303 Aug 24 15:31:46.952866 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 367/729] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:46 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:31:47.170973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-c5b2daeb-e876-4528-a00e-68fdd16b18fb req-61339be1-7007-4822-8939-b1b7daf1ccff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0ccb78-7647-4852-97e6-65c22d4637d3", "name": "network-vif-deleted", "tag": "da5494c3-1aed-4b57-8a4d-033c8c666fd9"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:31:47.185278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c5b2daeb-e876-4528-a00e-68fdd16b18fb req-61339be1-7007-4822-8939-b1b7daf1ccff service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:47.185760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c5b2daeb-e876-4528-a00e-68fdd16b18fb req-61339be1-7007-4822-8939-b1b7daf1ccff service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:47.186193 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c5b2daeb-e876-4528-a00e-68fdd16b18fb req-61339be1-7007-4822-8939-b1b7daf1ccff service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:47.198465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-c5b2daeb-e876-4528-a00e-68fdd16b18fb req-61339be1-7007-4822-8939-b1b7daf1ccff service nova] Creating event network-vif-deleted:da5494c3-1aed-4b57-8a4d-033c8c666fd9 for instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 on hv-cinder-84890 Aug 24 15:31:47.204493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-c5b2daeb-e876-4528-a00e-68fdd16b18fb req-61339be1-7007-4822-8939-b1b7daf1ccff service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039880 Aug 24 15:31:47.205166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 363/730] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:31:47.230281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:47.230281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:47.235975 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:47.236453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:47.236880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:47.237566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:47.238011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:47.238668 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:47.375869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:47.384828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:47.386340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:47.387479 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-82a7552b-3f0f-44dc-9af3-97b463fd2546 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.162470 Aug 24 15:31:47.388031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 368/731] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:47 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:47.973490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:47.974877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] [instance: 1e0ccb78-7647-4852-97e6-65c22d4637d3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:47.981058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:47.981535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:47.981966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:47.982697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:47.983257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:47.983545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:47.997123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] HTTP exception thrown: Instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 could not be found. Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Request method failure captured: Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 HTTP/1.1 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkNwwrM-oBthXouE-L9m5FMsPbvEThb6dv6VwXJKTJUECEn--kYUC2Xi1XnPsiDBb2zFGB3C5daiOJHOgUqHvs7CqKqRslIJMx9MpBa_Xjm8gzHhohp8m6mVRmB2LafKAuoGoyTSsfQSKVW8UR4S0Rqvac9Phh1fsSqqKvZSAuOoBx8 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 00071111c84346639e5245e5c173dad5 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-VolumesSnapshotTestJSON-334503720 Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:31:47.998778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/00071111c84346639e5245e5c173dad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/00071111c84346639e5245e5c173dad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_00071111c84346639e5245e5c173dad5", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/00071111c84346639e5245e5c173dad5"}]}] Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-VolumesSnapshotTestJSON-334503720 Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 00071111c84346639e5245e5c173dad5 Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-334503720 Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-VolumesSnapshotTestJSON-334503720-project Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 22c5f040350d4daba0ebe2af86849a23 Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-VolumesSnapshotTestJSON-334503720-project Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 could not be found. Aug 24 15:31:48.000460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '1e0ccb78-7647-4852-97e6-65c22d4637d3'} Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 could not be found. Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:31:48.001365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 could not be found. Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 could not be found. Aug 24 15:31:48.002872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:31:48.004103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] Returning 404 to user: Instance 1e0ccb78-7647-4852-97e6-65c22d4637d3 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:31:48.004103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2171425e-007b-445c-ac85-b8a0c1cae0e2 tempest-VolumesSnapshotTestJSON-334503720 tempest-VolumesSnapshotTestJSON-334503720-project] 10.222.0.76 "GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3" status: 404 len: 111 microversion: 2.1 time: 0.030948 Aug 24 15:31:48.004103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 364/732] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:31:47 2022] GET /compute/v2.1/servers/1e0ccb78-7647-4852-97e6-65c22d4637d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:31:48.411394 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:48.412526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:48.418982 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:48.419459 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:48.419890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:48.420684 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:48.421037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:48.421453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:48.564083 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:48.573380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:48.574942 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:48.576089 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-19fcdd56-07c3-434f-a645-f0ed0ae21b8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.168903 Aug 24 15:31:48.576644 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 369/733] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:48 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:49.599397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:49.600010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:49.606686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:49.607166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:49.607603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:49.608322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:49.608773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:49.609196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:49.611868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:49.745920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:49.754845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:49.756360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:49.757496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-14d64ae1-ed4d-4d31-8ef9-40748e0698d3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.162521 Aug 24 15:31:49.758043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 365/734] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:49 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:50.780461 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:50.781068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:50.788457 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:50.788932 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:50.789362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:50.790054 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:50.790534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:50.790958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:50.810838 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:50.928302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:50.937202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:50.938753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:50.939905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4cc7eb5b-6e07-466a-bb50-0d5b13f03a07 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.163456 Aug 24 15:31:50.940452 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 370/735] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:50 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:51.963858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:51.964475 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:51.971333 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:51.971821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:51.972258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:51.972949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:51.973404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:51.973829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:52.107741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:52.117002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:52.118547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:52.119926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-81e09871-9278-4aaa-8838-fc3a85f3485e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.159913 Aug 24 15:31:52.120487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 366/736] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:51 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:53.143602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:53.144211 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:53.151095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:53.151575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:53.152006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:53.152691 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:53.153140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:53.153560 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:53.286373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:53.296180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:53.297664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:53.298848 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bc9cf8d7-9d70-4886-a766-0802b747be0d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.159137 Aug 24 15:31:53.299401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 371/737] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:53 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:54.322890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:54.323431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:54.329967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:54.330478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:54.330914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:54.331589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:54.332032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:54.332460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:54.464601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:54.473279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:54.474786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:54.475928 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aa7fa960-e4e8-4572-bb10-e4636f514b14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.157027 Aug 24 15:31:54.476469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 367/738] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:54 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:55.499758 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:55.500497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:55.507173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:55.507722 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:55.508154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:55.508842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:55.509289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:55.509700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:55.641625 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:55.650928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:55.652439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:55.653645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fb801012-5faa-4ca9-8aa4-efbc118f0c23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.157960 Aug 24 15:31:55.654205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 372/739] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:55 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:56.677305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:56.677799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:56.680508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=46 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:31:56.689808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:56.690319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:56.690787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:56.691584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:56.692033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:56.692725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:56.838857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:56.847370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:56.848875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:56.850272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7fa752f1-2072-42a6-bbeb-19185c82209c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1755 microversion: 2.20 time: 0.176914 Aug 24 15:31:56.850821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 368/740] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:56 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:57.873399 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:57.874016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:57.880976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:57.881453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:57.881888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:57.882731 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:57.883183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:57.883780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:58.032453 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:58.041333 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:58.042860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:58.044006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-511b5ff8-f611-4202-b441-473d9743489d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.174636 Aug 24 15:31:58.044563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 373/741] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:57 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:31:59.079860 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:31:59.081436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:31:59.089912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:59.091061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:59.091820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:59.092665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:31:59.093807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:31:59.093807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:31:59.259028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:59.268635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:59.280122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:31:59.281524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3dccfb4f-a278-4cb4-8415-facb8f8a9b00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.214791 Aug 24 15:31:59.282423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 369/742] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:31:59 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:00.306694 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:00.307288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:00.313995 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:00.314526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:00.314954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:00.315801 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:00.316342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:00.316763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:00.473168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:00.483279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:00.484943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:00.486291 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a904b427-5df0-43b7-9c88-55fbdc4825e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.184676 Aug 24 15:32:00.486961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 374/743] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:00 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:01.515844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:01.516794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:01.528419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:01.529305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:01.530045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:01.531257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:01.532032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:01.532994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:01.714386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:01.723562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:01.725102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:01.726305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d9ff341a-42c3-4ee1-ba33-7e9e65e85705 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.217727 Aug 24 15:32:01.726862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 370/744] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:01 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:02.749441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:02.750006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:02.757681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:02.758158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:02.758625 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:02.759327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:02.759783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:02.760207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:02.921167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:02.931278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:02.932807 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:02.933955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-244942c7-117c-4e5c-8c2d-bc914cd4de59 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.188706 Aug 24 15:32:02.934534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 375/745] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:02 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:03.957474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:03.958095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:03.964507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:03.964987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:03.965410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:03.966096 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:03.966576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:03.966998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:04.095438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:04.104864 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:04.106488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:04.111594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bec188e7-3ebc-435c-8c33-cc1ee513586c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.157942 Aug 24 15:32:04.112158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 371/746] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:03 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:05.134857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:05.135464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:05.141869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:05.142380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:05.142814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:05.143500 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:05.143962 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:05.144385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:05.276240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:05.285146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:05.287157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:05.288312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d0c6cc1d-80a7-4f74-9afb-81186e0ce070 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.157368 Aug 24 15:32:05.288863 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 376/747] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:05 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:06.311441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:06.312048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:06.318996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:06.319465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:06.319895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:06.320566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:06.321010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:06.321426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:06.475633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:06.487139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:06.488724 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:06.490564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-674943ff-d2e4-4b95-ace3-4f1fdcb07565 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.182936 Aug 24 15:32:06.491381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 372/748] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:06 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:07.513898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:07.514579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:07.516404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:07.521609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:07.522092 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:07.522576 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:07.523274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:07.523733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:07.524160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:07.670447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:07.679627 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:07.681113 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:07.682309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-db1553ab-f0ef-4e36-a5de-74b6e59f7a41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.172384 Aug 24 15:32:07.682859 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 377/749] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:07 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:08.706540 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:08.707209 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:08.713755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:08.714257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:08.714698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:08.715400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:08.715847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:08.716271 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:08.849290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:08.857858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:08.859385 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:08.860557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a220175f-cc17-4adf-9eec-4f35a13fbed5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.157932 Aug 24 15:32:08.861115 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 373/750] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:08 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:09.885001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:09.885748 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:09.892288 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:09.892765 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:09.893223 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:09.893912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:09.894403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:09.894821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:10.043146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:10.052901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:10.054440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:10.055609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d2a396b2-91ec-4bad-8e22-d6cd8b136807 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.174582 Aug 24 15:32:10.056160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 378/751] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:09 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:11.082306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:11.083458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:11.089849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:11.090503 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:11.091038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:11.092012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:11.092681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:11.093321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:11.245874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:11.257415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:11.259305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:11.261330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-af221c04-13ee-410c-9e58-1057760816bf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.183337 Aug 24 15:32:11.262131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 374/752] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:11 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:12.284960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:12.286110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:12.292533 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:12.293016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:12.293451 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:12.294156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:12.294708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:12.295130 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:12.439736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:12.448729 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:12.450126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:12.451323 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0f928bdf-90ee-457d-912c-c24f1beee34e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.170745 Aug 24 15:32:12.451942 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 379/753] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:12 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:32:13.474553 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:13.475164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:13.481683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:13.482168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:13.482631 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:13.483323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:13.483768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:13.484191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:13.613396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:13.622457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:13.623949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:13.625100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-34f17966-3d65-4f99-9a1a-c3e3c10cdec2 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.154500 Aug 24 15:32:13.625654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 375/754] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:13 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:14.648370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:14.648963 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:14.655529 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:14.656000 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:14.656430 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:14.657118 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:14.657565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:14.657985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:14.790002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:14.798594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:14.800079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:14.801469 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a532e47e-34e7-455b-88c3-f20f7a91dd88 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.157384 Aug 24 15:32:14.801764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 380/755] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:14 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:15.823798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:15.824402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:15.830853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:15.831335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:15.831755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:15.832463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:15.832905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:15.833319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:15.960107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:15.968861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:15.970417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:15.971569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6444a267-1961-4730-95bd-f3b15bc6fb9f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.151661 Aug 24 15:32:15.972128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 376/756] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:15 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:16.996486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:16.997166 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:17.003782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:17.004832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:17.005270 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:17.006006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:17.006501 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:17.006925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:17.137450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:17.146208 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:17.147741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:17.148897 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-89487052-d0db-458d-a779-7429faeccc71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.156414 Aug 24 15:32:17.149488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 381/757] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:16 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:18.171299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:18.171938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:18.179303 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:18.179778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:18.180206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:18.180889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:18.181328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:18.181748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:18.312530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:18.325094 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:18.326617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:18.327768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0eb35922-1ad9-458c-8cf1-f2a41992f5ec tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.160368 Aug 24 15:32:18.328359 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 377/758] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:18 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:19.350832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:19.351419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:19.358041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:19.358575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:19.359013 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:19.359711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:19.360162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:19.360583 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:19.497997 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:19.507241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:19.509171 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:19.509911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6708fc28-a497-4275-9278-d76604c35b2f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.162980 Aug 24 15:32:19.510672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 382/759] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:19 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:20.536333 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:20.536965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:20.543348 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:20.543828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:20.544260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:20.544938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:20.545382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:20.545800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:20.548403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=78 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:20.675116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:20.683612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:20.685089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:20.686242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2a32b181-83d5-465a-915a-1771a0b53e62 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.156171 Aug 24 15:32:20.686801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 378/760] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:20 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:21.709365 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:21.710238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:21.716679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:21.717159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:21.717602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:21.718331 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:21.718786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:21.719211 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:21.721901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=75 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:21.863200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:21.871860 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:21.873286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:21.874600 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-744d47ce-4ddb-4435-9835-a984aac4b4f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.169525 Aug 24 15:32:21.875158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 383/761] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:21 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:22.897778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:22.898432 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:22.904835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:22.905337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:22.905975 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:22.906728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:22.907183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:22.907601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:23.050020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:23.059623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:23.061215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:23.062388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6de71f1a-b701-4725-906e-c98ec71b69b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.168976 Aug 24 15:32:23.062945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 379/762] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:22 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:24.085777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:24.086444 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:24.093013 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:24.093493 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:24.093926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:24.094645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:24.095099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:24.095523 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:24.228938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:24.237820 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:24.239455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:24.240601 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-275826fa-87df-48ea-8c9d-8edd1b34eb03 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.159394 Aug 24 15:32:24.241163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 384/763] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:24 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:25.264424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:25.264995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:25.271710 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:25.272186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:25.272611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:25.273290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:25.273768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:25.274186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:25.413353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:25.422464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:25.423935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:25.425147 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-96d2aa64-b015-46ae-8292-50fca0a53c25 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.164659 Aug 24 15:32:25.426206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 380/764] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:25 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:26.449406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:26.449935 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:26.456561 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:26.457069 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:26.457501 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:26.458189 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:26.458662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:26.459087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:26.596352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:26.605547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:26.607120 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:26.608258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8132a4d2-0196-473a-80b8-b4e2a9fb0e3b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.163174 Aug 24 15:32:26.608810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 385/765] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:26 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:27.636844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:27.640510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:27.645625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=26 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:32:27.649600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:27.650083 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:27.650598 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:27.651290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:27.651733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:27.657312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:27.803443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:27.812142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:27.813615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:27.814819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b270e873-e525-4990-b447-7985410af624 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.181972 Aug 24 15:32:27.816019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 381/766] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:27 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:28.320505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-590d0255-e8b4-43e6-aad3-a8044165c4dd req-4b08c473-3b4a-4a88-add7-018346b63d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "name": "network-vif-plugged", "status": "completed", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:32:28.330577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-590d0255-e8b4-43e6-aad3-a8044165c4dd req-4b08c473-3b4a-4a88-add7-018346b63d5a service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:28.331092 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-590d0255-e8b4-43e6-aad3-a8044165c4dd req-4b08c473-3b4a-4a88-add7-018346b63d5a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:28.331529 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-590d0255-e8b4-43e6-aad3-a8044165c4dd req-4b08c473-3b4a-4a88-add7-018346b63d5a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:28.343902 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-590d0255-e8b4-43e6-aad3-a8044165c4dd req-4b08c473-3b4a-4a88-add7-018346b63d5a service nova] Creating event network-vif-plugged:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:32:28.350043 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-590d0255-e8b4-43e6-aad3-a8044165c4dd req-4b08c473-3b4a-4a88-add7-018346b63d5a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253969 Aug 24 15:32:28.350899 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 386/767] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:32:28.839273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:28.839921 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:28.848025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:28.848514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:28.848944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:28.849684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:28.850400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:28.850830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:29.033253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:29.043210 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:29.044728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:29.045878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1763a836-f3ef-4902-8d15-870d607a453e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.210655 Aug 24 15:32:29.046652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 382/768] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:28 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:30.070985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:30.071780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:30.079864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:30.081243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:30.081695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:30.082998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:30.083452 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:30.084239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:30.244362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:30.259504 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:30.261566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:30.262997 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ab3930eb-649c-49f1-9f8b-12d80092f782 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.197477 Aug 24 15:32:30.263961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 387/769] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:30 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:31.298814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:31.300447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:31.317078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:31.317958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:31.318493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:31.319990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:31.320415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:31.321360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:31.503154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:31.515962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:31.517474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:31.518686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b9f3d5cf-943e-4135-ae55-70247e5c8304 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1811 microversion: 2.20 time: 0.225567 Aug 24 15:32:31.522304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 383/770] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:31 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1811 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:32.548742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:32:32.549874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:32:32.560599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:32.568698 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:32.569159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:32.570445 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:32:32.571137 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:32:32.571399 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:32:32.836047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:32.848072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:32.850401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:32:32.852354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d47ad263-bb5d-4e1f-80ed-c94dba74c151 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1798 microversion: 2.20 time: 0.308960 Aug 24 15:32:32.854244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 388/771] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:32:32 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1798 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:32:38.563238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-91e2692d-d6ed-4ae9-9b0c-fbcca7fd32d7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Action: 'create', calling method: .version_select at 0x7f66592e0d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-975404008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZWNRF80bRXmUc+1zRkSkZryVkaG4jEr7z2yLGkMoB1ZIPIfP3AGL8/kIZigZe4pyZKBjiyD9/0sw9sQfcIuXaY0VNPurdKHKzYEPIokshnAmr14YAQeUEVqNflI1wKOg=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:32:38.584255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-91e2692d-d6ed-4ae9-9b0c-fbcca7fd32d7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Getting quotas for project 68476a44d7ee4d1d9fbf3c7516885edf. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:32:38.591343 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-91e2692d-d6ed-4ae9-9b0c-fbcca7fd32d7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Getting quotas for user 63b945e0d46946bfad2d89a0fd15fd8c and project 68476a44d7ee4d1d9fbf3c7516885edf. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:32:38.635712 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-91e2692d-d6ed-4ae9-9b0c-fbcca7fd32d7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.294491 Aug 24 15:32:38.638660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 384/772] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:32:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:33:04.581519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1651019120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-975404008", "security_groups": [{"name": "tempest-secgroup-smoke-676665782"}], "networks": [{"uuid": "5f8d46d2-a4c9-41f8-a3f1-c65bd84ff8b5"}], "block_device_mapping_v2": [{"uuid": "c890c722-5baa-4db7-9f9b-599d50579ba9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:04.591202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=23 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.591866 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=31 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:04.695590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] validate_networks() for [('5f8d46d2-a4c9-41f8-a3f1-c65bd84ff8b5', None, None, None, None, None)] {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:33:05.071477 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:33:05.071890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:33:05.072359 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:33:05.072996 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:33:05.073520 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:33:05.083364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:05.083836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:05.084264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:05.084977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:05.085425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:05.085849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:05.102675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Getting quotas for project 68476a44d7ee4d1d9fbf3c7516885edf. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:33:05.106542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Getting quotas for user 63b945e0d46946bfad2d89a0fd15fd8c and project 68476a44d7ee4d1d9fbf3c7516885edf. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:33:05.166985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:33:05.169095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c890c722-5baa-4db7-9f9b-599d50579ba9',volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:33:05.298749 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-25b85ada-04f2-40eb-b34a-26d7bb6498c7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.721071 Aug 24 15:33:05.299399 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 389/773] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:33:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:33:05.314156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4d1bef4a-c5eb-4e18-ac3c-cfcbe733c7b8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:05.316822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4d1bef4a-c5eb-4e18-ac3c-cfcbe733c7b8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:05.318963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=35 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.321019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.322439 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:05.388283 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4d1bef4a-c5eb-4e18-ac3c-cfcbe733c7b8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:05.397473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4d1bef4a-c5eb-4e18-ac3c-cfcbe733c7b8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1088 microversion: 2.1 time: 0.090439 Aug 24 15:33:05.398046 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 385/774] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:05 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:06.418507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:06.419117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:06.429205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:06.429771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:06.431426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:06.431426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:06.431426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:06.431818 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:06.497006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:06.506345 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-13780988-17eb-4aae-92b2-311b85718e5d tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1204 microversion: 2.1 time: 0.091645 Aug 24 15:33:06.506917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 390/775] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:06 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:07.528185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:07.529464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:07.537103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:07.537594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:07.538135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:07.538876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:07.539335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:07.539764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:07.680404 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-40529033-841e-45d0-bc83-56b3f8a546ec req-9cdd9e6e-058a-4e69-b9f8-84d3e806ae17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:07.690594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-40529033-841e-45d0-bc83-56b3f8a546ec req-9cdd9e6e-058a-4e69-b9f8-84d3e806ae17 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:07.691396 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-40529033-841e-45d0-bc83-56b3f8a546ec req-9cdd9e6e-058a-4e69-b9f8-84d3e806ae17 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:07.691832 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-40529033-841e-45d0-bc83-56b3f8a546ec req-9cdd9e6e-058a-4e69-b9f8-84d3e806ae17 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:07.703309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-40529033-841e-45d0-bc83-56b3f8a546ec req-9cdd9e6e-058a-4e69-b9f8-84d3e806ae17 service nova] Creating event network-changed:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:33:07.708198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-40529033-841e-45d0-bc83-56b3f8a546ec req-9cdd9e6e-058a-4e69-b9f8-84d3e806ae17 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032471 Aug 24 15:33:07.708812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 391/776] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:33:07.777420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:07.786473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b2d911bd-01cc-4a72-9270-110885388689 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.263094 Aug 24 15:33:07.786854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 386/777] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:07 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:08.808834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:08.809446 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:08.815663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:08.816147 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:08.816611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:08.817304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:08.817761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:08.818186 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:08.956650 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:08.963865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-59ceb3f2-61a5-46f0-b18a-b97e263838f1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.159689 Aug 24 15:33:08.964482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 392/778] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:08 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:09.985574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:09.986193 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:09.992323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:09.992806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:09.993243 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:09.993932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:09.994418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:09.994846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:10.124205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:10.131811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6edbccd5-0dca-4736-9191-dbee2358688b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.151532 Aug 24 15:33:10.132723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 387/779] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:09 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:11.153170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:11.153764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:11.160840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:11.161317 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:11.161750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:11.162480 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:11.162934 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:11.163383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:11.290875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:11.298647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bd47b18c-44ff-4325-9453-37c02660551a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.149327 Aug 24 15:33:11.299769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 393/780] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:11 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:12.320294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:12.320862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:12.327179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:12.327681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:12.328109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:12.328786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:12.329228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:12.329644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:12.468396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:12.475965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e5e5e158-e3eb-49ff-a469-9a0a18bd30c1 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.160045 Aug 24 15:33:12.476518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 388/781] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:12 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:33:13.496840 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:13.497503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:13.503878 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:13.504363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:13.504802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:13.505510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:13.506018 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:13.506464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:13.635346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:13.643246 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-50c2e48f-33af-4eb0-a8cc-e490bfc01ec0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.150251 Aug 24 15:33:13.643816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 394/782] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:13 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:14.223349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:33:14.223605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:33:14.663425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:14.664035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:14.670426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:14.670907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:14.671361 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:14.672048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:14.672498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:14.672919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:14.805330 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:14.813075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c6d42836-9082-4711-ac0f-6dfbec2b9598 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.153517 Aug 24 15:33:14.813644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 389/783] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:14 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:15.834372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:15.835026 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:15.837283 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.837935 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:15.843660 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:15.844141 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:15.844571 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:15.845258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:15.845712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:15.846659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:15.978274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:15.985913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fa288eef-ddab-48cb-891d-f94beed6c684 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.155550 Aug 24 15:33:15.986507 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 395/784] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:15 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:17.007325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:17.007927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:17.009799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:17.015428 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:17.015914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:17.016351 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:17.017047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:17.017499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:17.017921 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:17.146636 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:17.155003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8439d742-bfe6-42d5-bd17-410f779787d0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.150682 Aug 24 15:33:17.155822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 390/785] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:17 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:18.176406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:18.177015 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:18.183458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:18.183933 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:18.184368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:18.185052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:18.185503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:18.185926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:18.320740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:18.329628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d091fee9-7f5e-4dee-94f9-c8664c25e212 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.157612 Aug 24 15:33:18.330763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 396/786] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:18 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:18.403228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-26f8957b-52ec-4efb-ba81-b6d52ad1b5ba req-db559fac-fa1f-439e-8b7b-fd4bc9a55f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "name": "network-vif-plugged", "status": "completed", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:18.415686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-26f8957b-52ec-4efb-ba81-b6d52ad1b5ba req-db559fac-fa1f-439e-8b7b-fd4bc9a55f51 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:18.416167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-26f8957b-52ec-4efb-ba81-b6d52ad1b5ba req-db559fac-fa1f-439e-8b7b-fd4bc9a55f51 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:18.416598 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-26f8957b-52ec-4efb-ba81-b6d52ad1b5ba req-db559fac-fa1f-439e-8b7b-fd4bc9a55f51 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:18.428030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-26f8957b-52ec-4efb-ba81-b6d52ad1b5ba req-db559fac-fa1f-439e-8b7b-fd4bc9a55f51 service nova] Creating event network-vif-plugged:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:33:18.433249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-26f8957b-52ec-4efb-ba81-b6d52ad1b5ba req-db559fac-fa1f-439e-8b7b-fd4bc9a55f51 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033673 Aug 24 15:33:18.434044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 391/787] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:33:19.351390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:19.352022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:19.358297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:19.358770 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:19.359224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:19.359901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:19.360347 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:19.360761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:19.725251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:19.732855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f311ca6f-c774-47f9-9d4b-78e54bed174c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.385293 Aug 24 15:33:19.733520 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 397/788] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:19 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:20.754841 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:20.755562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:20.762406 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:20.762882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:20.763310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:20.763987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:20.764431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:20.764849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:20.903972 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:20.911829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cfb8498b-5d8b-413b-9a2f-5cbfa8755f49 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1259 microversion: 2.1 time: 0.162130 Aug 24 15:33:20.912372 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 392/789] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:20 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:21.932889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:21.933497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:21.940346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:21.940828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:21.941271 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:21.941961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:21.942456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:21.942918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:22.075890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:22.084115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3a4e9676-6dae-44e1-be60-b09396a208a5 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1443 microversion: 2.1 time: 0.155186 Aug 24 15:33:22.084687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 398/790] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:21 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:22.104378 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:22.105254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:22.112392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:22.112861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:22.113287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:22.113959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:22.114437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:22.114856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:22.247945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:22.255616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-725e4726-68c6-4306-bf94-16f6a62c4509 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1443 microversion: 2.1 time: 0.155613 Aug 24 15:33:22.256188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 393/791] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:22 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:24.228237 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-64b4a4f2-7872-4f2a-88ef-689cc22fd3c6 req-6fc5e829-0a35-4794-9a36-a65e6e97d375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:24.238442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-64b4a4f2-7872-4f2a-88ef-689cc22fd3c6 req-6fc5e829-0a35-4794-9a36-a65e6e97d375 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:24.239271 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-64b4a4f2-7872-4f2a-88ef-689cc22fd3c6 req-6fc5e829-0a35-4794-9a36-a65e6e97d375 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:24.239786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-64b4a4f2-7872-4f2a-88ef-689cc22fd3c6 req-6fc5e829-0a35-4794-9a36-a65e6e97d375 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:24.251151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-64b4a4f2-7872-4f2a-88ef-689cc22fd3c6 req-6fc5e829-0a35-4794-9a36-a65e6e97d375 service nova] Creating event network-changed:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:33:24.256894 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-64b4a4f2-7872-4f2a-88ef-689cc22fd3c6 req-6fc5e829-0a35-4794-9a36-a65e6e97d375 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033208 Aug 24 15:33:24.257701 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 399/792] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:33:27.668105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:27.670288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:27.677239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:27.677707 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:27.678342 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:27.678838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:27.679281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:27.679697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:27.751602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e4bceeed-3e18-41d2-adfa-7e6a788bdc01 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/action" status: 202 len: 0 microversion: 2.1 time: 0.087021 Aug 24 15:33:27.752618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 394/793] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:33:27 2022] POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:33:27.762124 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:27.762869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:27.769156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:27.769581 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:27.770021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:27.770742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:27.771190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:27.771828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:27.925551 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:27.933940 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a9a32375-45e6-4d25-8983-565d4164ef6b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1751 microversion: 2.1 time: 0.176664 Aug 24 15:33:27.934542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 400/794] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:27 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:28.956241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:28.956930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:28.963265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:28.963745 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:28.964177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:28.964909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:28.965369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:28.965791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:29.115902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:29.124012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-203f5b2f-5c74-4c2c-8634-4630b0c8831c tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.172918 Aug 24 15:33:29.124569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 395/795] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:28 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:30.145796 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:30.146504 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:30.152939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:30.153418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:30.153846 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:30.154556 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:30.155007 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:30.155424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:30.302372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:30.310483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dd99f7cb-562e-48ea-902b-da9188d3a9dc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.168585 Aug 24 15:33:30.311033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 401/796] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:30 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:33:31.331498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:31.332093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:31.338472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:31.338941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:31.339363 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:31.340040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:31.340508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:31.340924 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:31.480016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:31.488810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-eff0cd08-7a88-4385-a4e6-0d7b2b88cf60 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.161197 Aug 24 15:33:31.489377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 396/797] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:31 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:33:32.509444 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:32.510051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:32.516485 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:32.516959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:32.517386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:32.518074 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:32.518546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:32.518961 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:32.669016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:32.678598 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3c4875a9-8f1a-4c1b-8623-4cc5a9b8da41 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.172862 Aug 24 15:33:32.679172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 402/798] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:32 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:33.700603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:33.701190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:33.707858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:33.708341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:33.708773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:33.709470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:33.709924 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:33.710375 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:33.856153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:33.866128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0883e5c5-3266-4b94-b754-c6fe297e663a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.169333 Aug 24 15:33:33.866735 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 397/799] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:33 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:34.888402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:34.888928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:34.891299 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:34.896411 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:34.896888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:34.897320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:34.898002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:34.898476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:34.898943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:34.903477 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=73 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.046736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:35.055882 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a15ed3c4-ea4a-4e13-9662-a5ba20ca953e tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.171325 Aug 24 15:33:35.056451 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 403/800] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:34 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:35.856166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dd7bb90-de45-489c-8c1c-492ca58f8fea"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:35.858554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:35.860490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=29 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:35.865906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:35.866427 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:35.866866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:35.867560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:35.868109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:35.868633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:35.871246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:36.077362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:36.077960 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:36.084846 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:36.085344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:36.085777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:36.086503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:36.086951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:36.087377 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:36.124531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-05032c07-5ac4-4bfc-9d97-23c38a97f1c3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375278 Aug 24 15:33:36.125553 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 398/801] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:33:35 2022] POST /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:33:36.238884 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:36.247550 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-20ba5c79-8d73-4011-b640-05d24583626a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.174049 Aug 24 15:33:36.248129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 404/802] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:36 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:33:37.269972 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:37.270720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:37.276831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:37.277308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:37.277737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:37.278441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:37.278885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:37.279299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:37.425267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:37.433328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e0b1afe9-31af-49fe-a567-15e9fc28f1fb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.167953 Aug 24 15:33:37.433881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 399/803] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:37 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:38.455449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:38.456058 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:38.462606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:38.463077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:38.463505 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:38.464184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:38.464634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:38.465046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:38.610001 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:38.618693 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7d7249b5-4b00-40f7-aec2-0bf483fa4813 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.167041 Aug 24 15:33:38.619248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 405/804] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:38 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:39.639051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:39.639573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:39.646586 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:39.647067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:39.647508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:39.648196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:39.648652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:39.649081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:39.789232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:39.797407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f448f565-ada3-432e-b769-575a6d807fb0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.162223 Aug 24 15:33:39.797969 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 400/805] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:39 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:40.818513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:40.819119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:40.825449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:40.825953 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:40.826421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:40.827183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:40.827656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:40.828072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:40.972793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:40.981235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7ca3a98d-5240-4dc7-b7e5-4a635df19c22 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.166551 Aug 24 15:33:40.981810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 406/806] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:40 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:42.003318 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:42.003988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:42.010386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:42.010869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:42.011284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:42.011956 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:42.012399 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:42.012814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:42.157126 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:42.166081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-11d44de7-e2b7-451f-891d-87dcc8a0afdc tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.166670 Aug 24 15:33:42.166676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 401/807] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:41 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:43.192268 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:43.193664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:43.202892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:43.203376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:43.203844 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:43.204597 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:43.205047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:43.205466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:43.352061 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:43.360133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-23551c40-675c-44b4-a061-ba2cb6b93b05 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.175628 Aug 24 15:33:43.361184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 407/808] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:43 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:43.646562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:43.648814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:43.655144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:43.655624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:43.656058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:43.656747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:43.657199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:43.657625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:43.680225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lazy-loading 'flavor' on Instance uuid c0867b09-cad0-497b-b0ec-15092faf6e1c {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:33:43.800648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5f6f6000-c780-40ee-b1ad-6d83a58798f6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/action" status: 200 len: 32 microversion: 2.1 time: 0.158537 Aug 24 15:33:43.801177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 402/809] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:33:43 2022] POST /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:33:43.810623 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:43.811235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:43.817762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:43.818351 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:43.818790 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:43.819492 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:43.819943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:43.820362 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:43.957391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:43.966624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-287e8b05-fe94-4108-8fb7-f2201d25a5c0 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.159710 Aug 24 15:33:43.967204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 408/810] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:43 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:44.382545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:44.383192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:44.389312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:44.389791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:44.390249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:44.390930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:44.391380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:44.392398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:44.536435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:44.545001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3d330163-0af0-4c84-9ed8-bb01e5b81ae3 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1756 microversion: 2.1 time: 0.166765 Aug 24 15:33:44.545558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 403/811] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:44 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:44.988116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:44.988859 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:44.995346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:44.995817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:44.996273 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:44.996955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:44.997406 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:44.997820 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:45.135741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:45.143875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fb2b5df0-3971-4902-8dca-3bae82f21266 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.160708 Aug 24 15:33:45.144438 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 409/812] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:44 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:45.567252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:45.567879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:45.574137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:45.574637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:45.575065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:45.575749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:45.576193 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:45.576610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:45.721543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:45.729691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-13c7a26a-3c38-4ba4-8c86-baa4cfeaa38b tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1759 microversion: 2.1 time: 0.167524 Aug 24 15:33:45.730265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 404/813] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:45 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:46.165712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:46.166383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:46.172705 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:46.173674 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:46.174106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:46.174826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:46.175281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:46.175901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:46.303904 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:46.312055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a2c62680-a393-4bc8-bc44-c745f55a804a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.150229 Aug 24 15:33:46.312612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 410/814] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:46 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:47.334027 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:47.334760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:47.340997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:47.341470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:47.341899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:47.342602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:47.343045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:47.343459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:47.469380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:47.477653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6113b8ef-2c23-49a3-91b2-6009576b5bf6 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.147923 Aug 24 15:33:47.478232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 405/815] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:47 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:48.498615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:48.499228 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:48.506636 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:48.507111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:48.507541 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:48.508227 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:48.508674 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:48.509090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:48.637904 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:48.646815 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e2e1ed57-885a-43eb-acf8-ee63e120fe92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.152072 Aug 24 15:33:48.647376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 411/816] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:48 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:49.668219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:49.668819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:49.676018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:49.676722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:49.677154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:49.677858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:49.678340 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:49.678760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:49.803381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:49.811521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ea7e0d87-cdaf-4d00-9273-4759c0fdadd5 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.147075 Aug 24 15:33:49.812068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 406/817] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:49 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:50.832792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:50.833340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:50.839871 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:50.840359 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:50.840797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:50.841502 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:50.841965 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:50.842423 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:50.976047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:50.984209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-587dc7fb-fad0-4a46-8ece-8975f50ec52d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.155421 Aug 24 15:33:50.984753 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 412/818] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:50 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:52.007058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:52.007649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:52.014037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.014545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.014979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.015659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.016106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.016582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.146062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:52.154190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-258b3f95-6f83-4e2a-a2c4-095c31146256 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.151104 Aug 24 15:33:52.154861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 407/819] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:52 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:52.499573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:52.500132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:52.506628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.507108 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.507516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.508202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.508645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.509062 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.539892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0e202ed6-e318-4dc9-831c-5a739d5de3b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments/d61ac1f5-f8ee-43b6-9c4e-86c2c0257c67" status: 200 len: 194 microversion: 2.20 time: 0.044332 Aug 24 15:33:52.540469 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 413/820] 10.222.0.76 () {60 vars in 1454 bytes} [Wed Aug 24 15:33:52 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments/d61ac1f5-f8ee-43b6-9c4e-86c2c0257c67 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 15:33:52.606069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:52.606762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:52.613448 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.614049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.614523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.615221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.615677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.616104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.693697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lazy-loading 'services' on Instance uuid 0ded4f04-fa28-4ffa-9541-fc8944cbe89a {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:33:52.762927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5bc93223-8af9-4352-8f54-c94d1ea17b28 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments/d61ac1f5-f8ee-43b6-9c4e-86c2c0257c67" status: 202 len: 0 microversion: 2.20 time: 0.160460 Aug 24 15:33:52.763597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 408/821] 10.222.0.76 () {60 vars in 1457 bytes} [Wed Aug 24 15:33:52 2022] DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments/d61ac1f5-f8ee-43b6-9c4e-86c2c0257c67 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:33:52.773442 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:52.775686 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:52.783093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.783648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.784885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.785817 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:52.786553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:52.786983 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:52.820104 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c70f95ca-6532-4e11-869f-dd4ed9a8248b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051804 Aug 24 15:33:52.820657 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 414/822] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 15:33:52 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:33:53.177450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:53.178167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:53.184413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:53.184885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:53.185314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:53.185991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:53.186471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:53.186917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:53.316717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:53.325297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3d1b4424-f4b8-4617-92ae-510e789a1d20 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.152553 Aug 24 15:33:53.325869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 409/823] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:53 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:53.832009 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:53.834037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:53.840444 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:53.840921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:53.841354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:53.842036 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:53.842518 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:53.842940 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:53.870916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-715a6d0a-cd58-40a3-bca6-33b0c426d8db tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042959 Aug 24 15:33:53.871452 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 415/824] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 15:33:53 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:53.934325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:53.934822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:53.941483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:53.941963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:53.942435 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:53.943122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:53.943575 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:53.944000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:53.968042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:33:53.971450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:54.047393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e4e73794-7a1b-414a-aea8-94828de8070d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 204 len: 0 microversion: 2.20 time: 0.116622 Aug 24 15:33:54.048573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 410/825] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 15:33:53 2022] DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 15:33:54.058628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:54.059234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:54.065231 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:54.065715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:54.066149 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:54.066881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:54.067336 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:54.067758 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:54.197835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:54.206613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:54.208106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:54.209243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d7fd1d27-5796-4955-8d44-3c795b6bae11 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.155864 Aug 24 15:33:54.209786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 416/826] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:33:54 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:33:54.347061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:54.347748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:54.354011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:54.354514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:54.354941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:54.355614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:54.356054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:54.356468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:54.487319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:54.495699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e9ca52ea-c920-4505-afef-bea9cb0cf348 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.152790 Aug 24 15:33:54.496275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 411/827] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:54 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:55.232418 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:55.233060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:55.240180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:55.240666 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:55.241093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:55.241783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:55.242261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:55.242675 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:55.375326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:55.383998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:55.385482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:55.386652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-81d427b5-be18-4f6c-96b9-e723e8d29a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.158144 Aug 24 15:33:55.387192 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 417/828] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:33:55 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:33:55.516967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:55.517569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:55.524425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:55.524896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:55.525319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:55.525995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:55.526467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:55.526888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:55.658373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:55.666997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b48ece14-2391-4a74-9ca4-30860338635d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.153815 Aug 24 15:33:55.667561 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 412/829] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:55 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:56.410673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:56.411242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:56.418120 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:56.418637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:56.419070 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:56.419777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:56.420224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:56.420656 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:56.558417 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:56.566645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:56.568155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:56.569313 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e37b005c-0f63-4378-9993-2637627a74b6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1726 microversion: 2.20 time: 0.163583 Aug 24 15:33:56.569862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 418/830] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:33:56 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:33:56.688722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:56.690772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:56.697421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:56.698016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:56.698584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:56.699355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:56.699884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:56.700321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:56.877553 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:56.886012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1680430c-c8c0-4453-92e1-9f5bebf437da tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.201774 Aug 24 15:33:56.886618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 413/831] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:56 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:57.202644 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-5748b729-17cd-4fbe-b035-407f1a4c93cb req-f1e3331a-2f65-42fa-a6f2-0e729d0c556f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ded4f04-fa28-4ffa-9541-fc8944cbe89a", "name": "network-vif-deleted", "tag": "b1755cbd-375e-425f-a507-06aacfa98d97"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:57.212527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5748b729-17cd-4fbe-b035-407f1a4c93cb req-f1e3331a-2f65-42fa-a6f2-0e729d0c556f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:57.213129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5748b729-17cd-4fbe-b035-407f1a4c93cb req-f1e3331a-2f65-42fa-a6f2-0e729d0c556f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:57.213591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5748b729-17cd-4fbe-b035-407f1a4c93cb req-f1e3331a-2f65-42fa-a6f2-0e729d0c556f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:57.225261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-5748b729-17cd-4fbe-b035-407f1a4c93cb req-f1e3331a-2f65-42fa-a6f2-0e729d0c556f service nova] Creating event network-vif-deleted:b1755cbd-375e-425f-a507-06aacfa98d97 for instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a on hv-cinder-84890 Aug 24 15:33:57.230045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-5748b729-17cd-4fbe-b035-407f1a4c93cb req-f1e3331a-2f65-42fa-a6f2-0e729d0c556f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030967 Aug 24 15:33:57.230755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 419/832] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:33:57.593085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:57.593973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:57.600120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:57.600602 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:57.601036 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:57.601732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:57.602183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:57.602633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:57.669477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:57.678769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:57.680305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:57.681480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-be46f867-369f-4936-8979-90e62d03e22d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 200 len: 1658 microversion: 2.20 time: 0.092408 Aug 24 15:33:57.682038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 414/833] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:33:57 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 1658 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:33:57.910564 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:57.911323 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:57.928046 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:57.928754 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:57.929429 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:57.930145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:57.930639 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:57.931241 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:57.948264 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=100 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:33:58.076648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:58.085958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3726abda-2dc5-45ba-a4e9-34f20cacd30a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.180288 Aug 24 15:33:58.086579 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 420/834] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:57 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:58.705744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:58.706406 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:58.712783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:58.713264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:58.713698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:58.714423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:58.714875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:58.715292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:58.729874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] HTTP exception thrown: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Request method failure captured: Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a HTTP/1.1 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMpp4vAR82E6nkqzysB-1alyhIhKQVyU-aT6nHiN3W5fj1AIa_sYK2wuX0Sk26x7c2QQh4kZgZC8xCA5gAJWYAHLQVtUJ7ECpQL6TfhFORUm7N3X-U_Gn8wNZBjxYfCMd991e1Q6uydSK73gycTvh0sM0L_1XyZsVJPfhbpUAUm9Us Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:33:58.731542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e39c6ca75a3466d93195fe245509bc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}] Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 56535a702f4344aa8a58f11406acf4c9 Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:33:58.733297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '0ded4f04-fa28-4ffa-9541-fc8944cbe89a'} Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:33:58.734199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:33:58.735834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:33:58.737201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Returning 404 to user: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:33:58.737201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d40eb2ae-2485-4c20-bb31-a550ee280dbf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 404 len: 111 microversion: 2.20 time: 0.031797 Aug 24 15:33:58.737201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 415/835] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:33:58 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:33:58.742526 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dd3dd938-28df-41f3-a707-c89eb3aa191e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '.version_select at 0x7f66595615e0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:58.766573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dd3dd938-28df-41f3-a707-c89eb3aa191e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947463283" status: 204 len: 0 microversion: 2.20 time: 0.027647 Aug 24 15:33:58.767704 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 421/836] 10.222.0.76 () {60 vars in 1262 bytes} [Wed Aug 24 15:33:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1947463283 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 15:33:59.107978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:33:59.108592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:33:59.115543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:59.116033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:59.116503 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:59.117362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:33:59.117821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:33:59.118273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:33:59.339997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:33:59.348931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-94ff507b-6b48-4c11-afd2-551c81cfdf39 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1735 microversion: 2.1 time: 0.245151 Aug 24 15:33:59.349747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 416/837] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:33:59 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:33:59.551561 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d4e60914-3bb9-4927-ada7-458ca1c5172e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'create', calling method: .version_select at 0x7f665db53940>, body: {"keypair": {"name": "tempest-keypair-162706876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPUy1+uv0Vj7g0YoNyNUM9rH0si9ClBWiZcyYP8yD9Df3bkXfUV8nwbK0Xep7nDGEjQwshSux9cBnYAUIf/z5gpYYuHU8/kTdPQJf7FS1BJOKw6IB18LAxKc+Dqid4Aew=="}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:33:59.569908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-d4e60914-3bb9-4927-ada7-458ca1c5172e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:33:59.573910 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-d4e60914-3bb9-4927-ada7-458ca1c5172e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for user 56535a702f4344aa8a58f11406acf4c9 and project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:33:59.597794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d4e60914-3bb9-4927-ada7-458ca1c5172e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050583 Aug 24 15:33:59.598926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 422/838] 10.222.0.76 () {62 vars in 1200 bytes} [Wed Aug 24 15:33:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 15:34:00.373006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:00.373607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:00.381601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.382094 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.382544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.383227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.383670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.384087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.531160 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:00.540781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-715e3e26-be4c-4d9a-8827-8d222775ba0f tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1715 microversion: 2.1 time: 0.171599 Aug 24 15:34:00.541447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 417/839] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:34:00 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:34:00.603878 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:00.604385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:00.610518 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.611040 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.611852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.612562 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.613020 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.613447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.740106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] HTTP exception thrown: Cannot 'detach_volume' instance c0867b09-cad0-497b-b0ec-15092faf6e1c while it is in vm_state rescued Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Request method failure captured: Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments/6dd7bb90-de45-489c-8c1c-492ca58f8fea HTTP/1.1 Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkOSc0dE1xmstci05otrZ4SP53WpoaOzS1Ogt7qYougQw2n0gIk-qn2dvMXW6wpsW7hGtRVeSwRBPOZbpZh7ufzHxLW7NWcB0n3NG1F-M-tnJTGAVtQ_jgvFGgVl2J1Vcge2SUZXR0zVL4wn80zYXRIrwoiQ929leEWqwq6YTS-oizw Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:34:00.741723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ce23bc924f714d72ad20d32a3f5b6d25", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}] Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 461b9a3987744067a62234aaa8d086d0 Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:34:00.743512 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Cannot 'detach_volume' instance c0867b09-cad0-497b-b0ec-15092faf6e1c while it is in vm_state rescued Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'server_id': 'c0867b09-cad0-497b-b0ec-15092faf6e1c', 'id': '6dd7bb90-de45-489c-8c1c-492ca58f8fea'} Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:34:00.744681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c0867b09-cad0-497b-b0ec-15092faf6e1c while it is in vm_state rescued Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c0867b09-cad0-497b-b0ec-15092faf6e1c while it is in vm_state rescued Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:34:00.746146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Returning 409 to user: Cannot 'detach_volume' instance c0867b09-cad0-497b-b0ec-15092faf6e1c while it is in vm_state rescued {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:34:00.747955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c3451fe1-9051-4e21-8fbf-5467c02ca8d3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments/6dd7bb90-de45-489c-8c1c-492ca58f8fea" status: 409 len: 152 microversion: 2.1 time: 0.143983 Aug 24 15:34:00.747955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 423/840] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:34:00 2022] DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments/6dd7bb90-de45-489c-8c1c-492ca58f8fea => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 15:34:00.752004 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:00.752531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:00.759309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.759789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.760224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.760922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.761373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.761790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.829696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-85dec13e-65ff-4196-a895-487630bc987d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "POST /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.081327 Aug 24 15:34:00.834001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 418/841] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:34:00 2022] POST /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:34:00.845394 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:00.846006 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:00.853017 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.853440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.853872 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.854671 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:00.855044 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:00.855467 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:00.929818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1281765212", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db7ab943-70b8-4787-bf6b-c7f7cf735153"}], "security_groups": [{"name": "tempest-securitygroup--2141474301"}], "key_name": "tempest-keypair-162706876", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:01.003873 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:01.013095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a1005918-b711-4b13-915d-5578eeb61e68 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1723 microversion: 2.1 time: 0.172035 Aug 24 15:34:01.013814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 424/842] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:34:00 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:34:01.071849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] validate_networks() for [('db7ab943-70b8-4787-bf6b-c7f7cf735153', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:34:01.714478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:34:01.715085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:34:01.715351 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:34:01.715782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:34:01.716187 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:34:01.725012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:01.725482 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:01.725935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:01.726690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:01.727139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:01.727557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:01.743615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:34:01.747412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Getting quotas for user 56535a702f4344aa8a58f11406acf4c9 and project 7e39c6ca75a3466d93195fe245509bc9. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:34:01.758483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:34:01.760792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:34:01.806415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7155432f-e202-44a9-bd80-5815b4126593 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.881592 Aug 24 15:34:01.807057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 419/843] 10.222.0.76 () {62 vars in 1188 bytes} [Wed Aug 24 15:34:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 15:34:01.818532 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7d613be0-658d-49a3-88d2-b82b2b806e41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:01.819138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7d613be0-658d-49a3-88d2-b82b2b806e41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:01.877571 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7d613be0-658d-49a3-88d2-b82b2b806e41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:01.885072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7d613be0-658d-49a3-88d2-b82b2b806e41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:01.886672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7d613be0-658d-49a3-88d2-b82b2b806e41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:01.887704 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7d613be0-658d-49a3-88d2-b82b2b806e41 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1281 microversion: 2.20 time: 0.073193 Aug 24 15:34:01.888257 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 425/844] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:01 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:02.035594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:02.036247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:02.042605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:02.043173 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:02.043609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:02.044438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:02.044925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:02.045464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:02.179250 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:02.187433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-eca50434-4106-4f23-9782-754b07acb64a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1723 microversion: 2.1 time: 0.156614 Aug 24 15:34:02.188011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 420/845] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:34:02 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:34:02.911341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:02.911885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:02.918972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:02.919458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:02.919897 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:02.920590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:02.921048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:02.921475 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:02.980845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:02.989312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:02.990880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:02.991987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-971c9e41-f5bd-453a-bacb-76038e220f58 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1285 microversion: 2.20 time: 0.085593 Aug 24 15:34:02.992535 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 426/846] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:02 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:03.209250 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:03.209931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:03.216861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:03.217350 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:03.217807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:03.218552 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:03.219003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:03.219426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:03.355200 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:03.363968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2e531b63-b258-495a-9385-23ef8671bf92 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1723 microversion: 2.1 time: 0.158570 Aug 24 15:34:03.364529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 421/847] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:34:03 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:34:04.014721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:04.015338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:04.022741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:04.023224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:04.023659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:04.024366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:04.024808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:04.025234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:04.088081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:04.096107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:04.098028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:04.099152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5ab59a26-b68d-49f4-8d50-01da14c2b3a1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1277 microversion: 2.20 time: 0.088284 Aug 24 15:34:04.099696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 427/848] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:04 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:04.384914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:04.385531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:04.391986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:04.392465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:04.392899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:04.393584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:04.394031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:04.394487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:04.524247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:04.533682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-93995774-80ad-4b94-8bc8-6def8a9c4707 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1723 microversion: 2.1 time: 0.152012 Aug 24 15:34:04.533682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 422/849] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:34:04 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:34:05.122546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:05.123829 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:05.127867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:05.135022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:05.135516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:05.136136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:05.136843 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:05.137298 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:05.137831 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:05.203335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:05.211443 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:05.213137 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:05.214254 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1d8a2475-ce22-4a1e-af3d-54d35f3759bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1339 microversion: 2.20 time: 0.096098 Aug 24 15:34:05.214812 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 428/850] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:05 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:05.554798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:05.555416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:05.562028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:05.562548 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:05.562990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:05.563691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:05.564142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:05.564567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:05.780080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:05.789192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a83aff16-72d1-451e-b7c1-203f7923fba3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1729 microversion: 2.1 time: 0.238118 Aug 24 15:34:05.789698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 423/851] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:34:05 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:34:05.810768 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:05.811436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:05.819826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:05.820594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:05.821253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:05.822041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:05.822596 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:05.823136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:06.063263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ec7c6601-7989-4a28-8b78-c21d676da1e2 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.256762 Aug 24 15:34:06.064257 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 429/852] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:34:05 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:34:06.237670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:06.238294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:06.240842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:06.246357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:06.246846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:06.247276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:06.247967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:06.248412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:06.249006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:06.647119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:06.658543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:06.661225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:06.662399 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3577cbe3-4970-4f95-865f-522a9c41e264 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.429212 Aug 24 15:34:06.662960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 424/853] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:06 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:07.250927 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-d8ea91a8-8590-47bb-8530-dcdbbed9e53e req-420f68c4-7e74-46d5-b252-fba87d67024b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:07.260160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d8ea91a8-8590-47bb-8530-dcdbbed9e53e req-420f68c4-7e74-46d5-b252-fba87d67024b service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:07.260630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d8ea91a8-8590-47bb-8530-dcdbbed9e53e req-420f68c4-7e74-46d5-b252-fba87d67024b service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:07.261049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-d8ea91a8-8590-47bb-8530-dcdbbed9e53e req-420f68c4-7e74-46d5-b252-fba87d67024b service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:07.272382 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-d8ea91a8-8590-47bb-8530-dcdbbed9e53e req-420f68c4-7e74-46d5-b252-fba87d67024b service nova] Creating event network-changed:fbe0cd2d-eada-4502-bc94-eb462c1463d7 for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 on hv-cinder-84890 Aug 24 15:34:07.277302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-d8ea91a8-8590-47bb-8530-dcdbbed9e53e req-420f68c4-7e74-46d5-b252-fba87d67024b service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Aug 24 15:34:07.278102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 430/854] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:34:07.684977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:07.685585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:07.691981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:07.692546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:07.692897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:07.693584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:07.694031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:07.694482 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:07.982715 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:07.992322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:07.993939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:07.995192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-13113ca8-12c3-43c4-b379-63bcf38b6e67 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.314134 Aug 24 15:34:07.995822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 425/855] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:07 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:09.019696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:09.020384 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:09.026434 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:09.026914 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:09.027343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:09.028026 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:09.028473 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:09.028891 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:09.160203 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:09.168338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:09.169836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:09.170974 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-777c7af2-9d6b-45e7-8555-105d36649387 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.156638 Aug 24 15:34:09.171517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 431/856] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:09 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:09.299466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0867b09-cad0-497b-b0ec-15092faf6e1c", "tag": "922a4b3f-f7ee-436d-8411-f2e3508ed3d3"}, {"name": "network-changed", "server_uuid": "c0867b09-cad0-497b-b0ec-15092faf6e1c", "tag": "922a4b3f-f7ee-436d-8411-f2e3508ed3d3"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:09.308907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:09.309384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:09.309817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:09.313891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:09.321718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] Creating event network-changed:922a4b3f-f7ee-436d-8411-f2e3508ed3d3 for instance c0867b09-cad0-497b-b0ec-15092faf6e1c on hv-cinder-84890 Aug 24 15:34:09.322244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] Creating event network-changed:922a4b3f-f7ee-436d-8411-f2e3508ed3d3 for instance c0867b09-cad0-497b-b0ec-15092faf6e1c on hv-cinder-84890 Aug 24 15:34:09.327496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-10f0d752-9141-4476-9efc-3f3912ad69b3 req-48d2f40c-6dc7-4e63-a960-31898a583965 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031679 Aug 24 15:34:09.328055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 426/857] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:34:10.193370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:10.194000 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:10.200564 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:10.201052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:10.201486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:10.202170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:10.202652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:10.203073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:10.332667 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:10.340775 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:10.342293 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:10.343400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3880f85c-36e4-48a8-84a5-10af9e661384 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.154006 Aug 24 15:34:10.343966 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 432/858] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:10 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:11.367612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:11.369038 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:11.376195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:11.377011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:11.377525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:11.378344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:11.378861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:11.379354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:11.596943 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:11.607042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:11.608665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:11.610392 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-22afc18d-f7c3-4626-90d9-ebec3b41e2e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.248020 Aug 24 15:34:11.611267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 427/859] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:11 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:12.634049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:12.634741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:12.637068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:12.643230 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:12.643708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:12.644133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:12.644828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:12.645278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:12.645697 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:12.779481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:12.788070 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:12.789615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:12.790761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-68690616-2262-48de-a540-ec72ac9fa827 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.160628 Aug 24 15:34:12.791364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 433/860] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:12 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:34:13.814078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:13.814634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:13.816519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:13.817169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=6 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:13.823628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:13.824093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:13.824519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:13.825195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:13.825638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:13.826052 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:13.956994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:13.965124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:13.966623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:13.967719 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-37ed5f3f-2e8c-4f14-830d-b3b4b9c39e1d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.158080 Aug 24 15:34:13.968269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 428/861] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:13 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:14.663387 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-22b7b004-df05-4edc-b26e-1eb5465f6b70 req-5e2700ec-edcf-456b-a964-de686386ed99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "name": "network-vif-plugged", "status": "completed", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:14.673340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-22b7b004-df05-4edc-b26e-1eb5465f6b70 req-5e2700ec-edcf-456b-a964-de686386ed99 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:14.674030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-22b7b004-df05-4edc-b26e-1eb5465f6b70 req-5e2700ec-edcf-456b-a964-de686386ed99 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:14.674554 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-22b7b004-df05-4edc-b26e-1eb5465f6b70 req-5e2700ec-edcf-456b-a964-de686386ed99 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:14.685789 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-22b7b004-df05-4edc-b26e-1eb5465f6b70 req-5e2700ec-edcf-456b-a964-de686386ed99 service nova] Creating event network-vif-plugged:fbe0cd2d-eada-4502-bc94-eb462c1463d7 for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 on hv-cinder-84890 Aug 24 15:34:14.690764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-22b7b004-df05-4edc-b26e-1eb5465f6b70 req-5e2700ec-edcf-456b-a964-de686386ed99 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031350 Aug 24 15:34:14.691521 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 434/862] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:34:14.991476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:14.992084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:14.998497 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:14.998976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:14.999411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:15.000578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:15.001028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:15.001449 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:15.129498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:15.137543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:15.139154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:15.140236 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-11613cfb-eeaf-49a4-bf6b-89a34e8e10e9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.153613 Aug 24 15:34:15.140831 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 429/863] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:14 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:16.164269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:16.165002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:16.171169 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:16.171647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:16.172584 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:16.173276 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:16.173733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:16.174190 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:16.301038 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:16.309115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:16.310647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:16.311749 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0c0ebd83-42f9-4001-955e-c77bc09b4a23 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1407 microversion: 2.20 time: 0.152509 Aug 24 15:34:16.312363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 435/864] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:16 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:17.334699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:17.335332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:17.341711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:17.342182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:17.342644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:17.343315 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:17.343760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:17.344177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:17.473335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:17.481363 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:17.482888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:34:17.484035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9c6d11af-0d48-4e25-b350-517ed79ac301 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1599 microversion: 2.20 time: 0.153238 Aug 24 15:34:17.485131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 430/865] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:34:17 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:34:17.507302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:17.507858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:17.514126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:17.514648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:17.515087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:17.516382 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:17.516887 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:17.517318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:17.600347 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c1de206c-df8b-46b7-ac6e-1d8a7975be8f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097020 Aug 24 15:34:17.600943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 436/866] 10.222.0.76 () {60 vars in 1316 bytes} [Wed Aug 24 15:34:17 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:34:18.499611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-9d0c5102-a805-47c8-80de-5f5dbc3e6126 req-81ceeac3-9751-4da9-9194-c76ef4badeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:18.510212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-9d0c5102-a805-47c8-80de-5f5dbc3e6126 req-81ceeac3-9751-4da9-9194-c76ef4badeb1 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:18.510720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-9d0c5102-a805-47c8-80de-5f5dbc3e6126 req-81ceeac3-9751-4da9-9194-c76ef4badeb1 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:18.511154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-9d0c5102-a805-47c8-80de-5f5dbc3e6126 req-81ceeac3-9751-4da9-9194-c76ef4badeb1 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:18.522889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-9d0c5102-a805-47c8-80de-5f5dbc3e6126 req-81ceeac3-9751-4da9-9194-c76ef4badeb1 service nova] Creating event network-changed:fbe0cd2d-eada-4502-bc94-eb462c1463d7 for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 on hv-cinder-84890 Aug 24 15:34:18.527774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-9d0c5102-a805-47c8-80de-5f5dbc3e6126 req-81ceeac3-9751-4da9-9194-c76ef4badeb1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031836 Aug 24 15:34:18.528690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 431/867] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:34:57.504396 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=17 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:57.505379 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=69 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:57.668947 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1793632787"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:57.669486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:57.675440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:57.675916 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:57.676349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:57.677033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:57.677486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:57.677903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:57.803351 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.network.security_group_api [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Removing security group d2070089-b818-4782-bad8-c0187230d41a from port e8b0b45d-ec97-4a0f-bf7e-2ef583da561a Aug 24 15:34:58.115266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0e9f2054-d8db-41d9-a7b3-f0267ac4b36f tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/action" status: 202 len: 0 microversion: 2.1 time: 0.612371 Aug 24 15:34:58.125206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=15 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:58.126525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=27 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:34:58.129203 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 437/868] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:34:57 2022] POST /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:34:58.201086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-0698fc7f-46c0-419e-a107-3d60165dfed4 req-bfa7c8f9-3196-4e8b-a496-c76cb79e570f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:58.211321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-0698fc7f-46c0-419e-a107-3d60165dfed4 req-bfa7c8f9-3196-4e8b-a496-c76cb79e570f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:58.211832 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-0698fc7f-46c0-419e-a107-3d60165dfed4 req-bfa7c8f9-3196-4e8b-a496-c76cb79e570f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:58.212262 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-0698fc7f-46c0-419e-a107-3d60165dfed4 req-bfa7c8f9-3196-4e8b-a496-c76cb79e570f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:58.225935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-0698fc7f-46c0-419e-a107-3d60165dfed4 req-bfa7c8f9-3196-4e8b-a496-c76cb79e570f service nova] Creating event network-changed:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:34:58.231248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-0698fc7f-46c0-419e-a107-3d60165dfed4 req-bfa7c8f9-3196-4e8b-a496-c76cb79e570f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108160 Aug 24 15:34:58.232048 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 432/869] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:34:59.188568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:59.189081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:59.191885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-ff50198d-4f4b-45e8-91fb-7579cad9bcf4 req-9eb9b200-fee5-45ea-bc07-6246a4e5e830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:34:59.195366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:59.195923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:59.196428 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:59.197194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:59.198106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:59.198388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:59.201808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ff50198d-4f4b-45e8-91fb-7579cad9bcf4 req-9eb9b200-fee5-45ea-bc07-6246a4e5e830 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:59.202821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ff50198d-4f4b-45e8-91fb-7579cad9bcf4 req-9eb9b200-fee5-45ea-bc07-6246a4e5e830 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:59.203479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ff50198d-4f4b-45e8-91fb-7579cad9bcf4 req-9eb9b200-fee5-45ea-bc07-6246a4e5e830 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:59.226018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-ff50198d-4f4b-45e8-91fb-7579cad9bcf4 req-9eb9b200-fee5-45ea-bc07-6246a4e5e830 service nova] Creating event network-changed:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:34:59.231158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-ff50198d-4f4b-45e8-91fb-7579cad9bcf4 req-9eb9b200-fee5-45ea-bc07-6246a4e5e830 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044934 Aug 24 15:34:59.231942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 433/870] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:34:59.299141 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lazy-loading 'services' on Instance uuid f548c0bc-3b6d-4849-b88d-cba3177bde97 {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:34:59.423513 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-60270153-ce11-451a-9b29-fb52e8fb9df0 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments/c7ee5e6e-1e40-45c5-b878-29bca03647be" status: 202 len: 0 microversion: 2.1 time: 0.239533 Aug 24 15:34:59.427825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 438/871] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:34:59 2022] DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments/c7ee5e6e-1e40-45c5-b878-29bca03647be => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:34:59.435033 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:34:59.438085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:34:59.450504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:59.451780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:59.453278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:59.455164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:34:59.456184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:34:59.457433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:34:59.508618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-63265a52-4663-4102-9c24-9d2409194792 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078612 Aug 24 15:34:59.515731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 434/872] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:34:59 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:00.522648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:00.524978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:00.531759 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:00.532244 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:00.532679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:00.533374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:00.534013 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:00.534511 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:00.563517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-55985c63-0179-45f3-b7b8-46efb2b2634a tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045646 Aug 24 15:35:00.564053 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 439/873] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:35:00 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:35:00.574440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:00.575207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:00.581835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:00.582348 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:00.582781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:00.583502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:00.583951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:00.584373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:00.658369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] HTTP exception thrown: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 is not attached to volume c7ee5e6e-1e40-45c5-b878-29bca03647be Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Request method failure captured: Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments/c7ee5e6e-1e40-45c5-b878-29bca03647be HTTP/1.1 Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkPpnbgNGt0Ds4ZrFpn1tz9X9__pohvhSiDyzTiJqu6jjct_BcrqOxFdcrXAYTfTBcWKmAuJJr66EFkXf8LxXoZ3K4y60FlGnN9snId-vJQpokRIhLa9A-Gf2-QZrdqSpi72ldMkhfItxZK0e4x_PUusmDwZLTXG9l_RijDGby19OPM Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 60386a4f71754e4396434dfa34c55b75 Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestMinimumBasicScenario-1372560393 Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:35:00.664872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60386a4f71754e4396434dfa34c55b75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60386a4f71754e4396434dfa34c55b75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60386a4f71754e4396434dfa34c55b75", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60386a4f71754e4396434dfa34c55b75"}]}] Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestMinimumBasicScenario-1372560393 Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 60386a4f71754e4396434dfa34c55b75 Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1372560393 Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestMinimumBasicScenario-1372560393-project Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 24396d51e9d243f7920f9fc309d66115 Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestMinimumBasicScenario-1372560393-project Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:35:00.666387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 is not attached to volume c7ee5e6e-1e40-45c5-b878-29bca03647be Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'server_id': 'f548c0bc-3b6d-4849-b88d-cba3177bde97', 'id': 'c7ee5e6e-1e40-45c5-b878-29bca03647be'} Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c7ee5e6e-1e40-45c5-b878-29bca03647be. Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:35:00.667305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 is not attached to volume c7ee5e6e-1e40-45c5-b878-29bca03647be Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 is not attached to volume c7ee5e6e-1e40-45c5-b878-29bca03647be Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:00.668775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Returning 404 to user: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 is not attached to volume c7ee5e6e-1e40-45c5-b878-29bca03647be {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:35:00.669729 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-55e30474-4789-455e-86d0-1c3dea5efdfb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments/c7ee5e6e-1e40-45c5-b878-29bca03647be" status: 404 len: 154 microversion: 2.1 time: 0.095925 Aug 24 15:35:00.669729 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 435/874] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:35:00 2022] DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97/os-volume_attachments/c7ee5e6e-1e40-45c5-b878-29bca03647be => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:35:01.801833 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:01.802399 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:01.808814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:01.809305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:01.809750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:01.810476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:01.811419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:01.811862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:01.836563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:35:01.918132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1f08431c-1c53-4bc8-932d-29a46c57b243 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 204 len: 0 microversion: 2.1 time: 0.119785 Aug 24 15:35:01.919064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 440/875] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:35:01 2022] DELETE /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:35:01.927484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:01.928100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:01.934400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:01.934881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:01.935314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:01.936585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:01.937054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:01.937479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:02.072541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:02.080158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-60cf5ef3-7d50-4602-9a16-0dd5916321eb tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1554 microversion: 2.1 time: 0.156541 Aug 24 15:35:02.080716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 436/876] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:01 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:02.616705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:35:02.616981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:35:03.101586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:03.102320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:03.109300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:03.109785 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:03.110239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:03.110963 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:03.111408 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:03.111839 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:03.246984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:03.255015 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-70fa3b46-de83-495e-9d23-bce7947ad2dd tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1554 microversion: 2.1 time: 0.157331 Aug 24 15:35:03.255567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 441/877] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:03 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:04.276015 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:04.276611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:04.283626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:04.284045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:04.284732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:04.285516 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:04.286002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:04.286451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:04.421970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24396d51e9d243f7920f9fc309d66115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60386a4f71754e4396434dfa34c55b75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:04.430656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7e70a657-2d24-4574-9925-71b9659aeb13 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 200 len: 1554 microversion: 2.1 time: 0.158430 Aug 24 15:35:04.431263 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 437/878] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:04 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:04.476659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-4d480b62-a14d-46dd-9ea9-7f0a176ea1f0 req-cf53a234-59ee-4815-815b-f9645481826c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f548c0bc-3b6d-4849-b88d-cba3177bde97", "name": "network-vif-deleted", "tag": "e8b0b45d-ec97-4a0f-bf7e-2ef583da561a"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:35:04.487441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4d480b62-a14d-46dd-9ea9-7f0a176ea1f0 req-cf53a234-59ee-4815-815b-f9645481826c service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:04.487835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4d480b62-a14d-46dd-9ea9-7f0a176ea1f0 req-cf53a234-59ee-4815-815b-f9645481826c service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:04.488260 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4d480b62-a14d-46dd-9ea9-7f0a176ea1f0 req-cf53a234-59ee-4815-815b-f9645481826c service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:04.499543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-4d480b62-a14d-46dd-9ea9-7f0a176ea1f0 req-cf53a234-59ee-4815-815b-f9645481826c service nova] Creating event network-vif-deleted:e8b0b45d-ec97-4a0f-bf7e-2ef583da561a for instance f548c0bc-3b6d-4849-b88d-cba3177bde97 on hv-cinder-84890 Aug 24 15:35:04.504732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-4d480b62-a14d-46dd-9ea9-7f0a176ea1f0 req-cf53a234-59ee-4815-815b-f9645481826c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031825 Aug 24 15:35:04.505320 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 442/879] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:05.452810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:05.453439 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] [instance: f548c0bc-3b6d-4849-b88d-cba3177bde97] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:05.461701 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:05.462199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:05.462669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:05.463369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:05.463818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:05.464242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:05.477462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] HTTP exception thrown: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 could not be found. Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Request method failure captured: Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 HTTP/1.1 Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkPpnbgNGt0Ds4ZrFpn1tz9X9__pohvhSiDyzTiJqu6jjct_BcrqOxFdcrXAYTfTBcWKmAuJJr66EFkXf8LxXoZ3K4y60FlGnN9snId-vJQpokRIhLa9A-Gf2-QZrdqSpi72ldMkhfItxZK0e4x_PUusmDwZLTXG9l_RijDGby19OPM Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 60386a4f71754e4396434dfa34c55b75 Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestMinimumBasicScenario-1372560393 Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:35:05.479035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/60386a4f71754e4396434dfa34c55b75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60386a4f71754e4396434dfa34c55b75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_60386a4f71754e4396434dfa34c55b75", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/60386a4f71754e4396434dfa34c55b75"}]}] Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestMinimumBasicScenario-1372560393 Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 60386a4f71754e4396434dfa34c55b75 Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1372560393 Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestMinimumBasicScenario-1372560393-project Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 24396d51e9d243f7920f9fc309d66115 Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestMinimumBasicScenario-1372560393-project Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 could not be found. Aug 24 15:35:05.480404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'f548c0bc-3b6d-4849-b88d-cba3177bde97'} Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 could not be found. Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:35:05.481154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 could not be found. Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 could not be found. Aug 24 15:35:05.482642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:05.484039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Returning 404 to user: Instance f548c0bc-3b6d-4849-b88d-cba3177bde97 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:35:05.484039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6c01308c-7e14-4731-bbb0-f4c2162168c1 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97" status: 404 len: 111 microversion: 2.1 time: 0.032053 Aug 24 15:35:05.484039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 438/880] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:05 2022] GET /compute/v2.1/servers/f548c0bc-3b6d-4849-b88d-cba3177bde97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:35:05.490416 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0032751a-c8cf-4782-902e-56a0d81cf1a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] Calling method '.version_select at 0x7f665a7a6af0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:05.515648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0032751a-c8cf-4782-902e-56a0d81cf1a9 tempest-TestMinimumBasicScenario-1372560393 tempest-TestMinimumBasicScenario-1372560393-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-491574104" status: 202 len: 0 microversion: 2.1 time: 0.030138 Aug 24 15:35:05.516448 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 443/881] 10.222.0.76 () {58 vars in 1269 bytes} [Wed Aug 24 15:35:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-491574104 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:35:14.405054 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:14.405585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:14.412104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:14.412584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:14.413016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:14.413701 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:14.414152 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:14.414599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:14.492222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lazy-loading 'services' on Instance uuid c0867b09-cad0-497b-b0ec-15092faf6e1c {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:35:14.563168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-86c1e4bd-d787-4714-8960-7d6d9df3c008 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments/6dd7bb90-de45-489c-8c1c-492ca58f8fea" status: 202 len: 0 microversion: 2.1 time: 0.162446 Aug 24 15:35:14.563900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 439/882] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:35:14 2022] DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments/6dd7bb90-de45-489c-8c1c-492ca58f8fea => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:35:14.569793 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:14.574602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:14.577547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:14.585641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:14.586351 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:14.587157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:14.587903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:14.588360 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:14.589022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:14.620889 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8dc04d1f-4590-4b97-9fd8-d78cf2961151 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052440 Aug 24 15:35:14.621431 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 444/883] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:35:14 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:15.634041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:15.636362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:15.642545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:15.643027 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:15.643451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:15.644159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:15.644599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:15.645015 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:15.673293 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7dcb526a-24a2-44ce-8a56-36900ff8ebaa tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044011 Aug 24 15:35:15.673840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 440/884] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:35:15 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:35:15.752968 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:15.753494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:15.759786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:15.760263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:15.760700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:15.761389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:15.761845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:15.762305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:15.787026 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:35:15.859253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2588da23-38ba-4697-ba28-1ec04bdfbf4e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 204 len: 0 microversion: 2.1 time: 0.109989 Aug 24 15:35:15.860134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 445/885] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:35:15 2022] DELETE /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:35:15.868766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:15.869376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:15.875292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:15.875768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:15.876199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:15.876889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:15.877348 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:15.877764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:16.008211 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:16.016292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-03ff8236-f4fc-45eb-9d95-c05ff0fea829 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1689 microversion: 2.1 time: 0.151613 Aug 24 15:35:16.016856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 441/886] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:15 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:17.038088 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:17.038830 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:17.045740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:17.046240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:17.046680 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:17.047368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:17.047825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:17.048249 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:17.176850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:17.184508 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c7b70804-faa9-43a7-bb37-bf43753b7338 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1689 microversion: 2.1 time: 0.150940 Aug 24 15:35:17.185058 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 446/887] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:17 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:18.208217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:18.208824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:18.215182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:18.215656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:18.216083 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:18.216760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:18.217203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:18.217624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:18.347518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:18.355110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8f6448a1-bd5e-4ef1-957e-62f3be5e5162 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1689 microversion: 2.1 time: 0.151922 Aug 24 15:35:18.355784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 442/888] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:18 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:19.376412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:19.377016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:19.383447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:19.383929 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:19.384369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:19.385065 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:19.385531 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:19.385955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:19.558842 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:19.566950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a609ec6c-ee88-4f01-b594-d05561af3c1d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1689 microversion: 2.1 time: 0.194342 Aug 24 15:35:19.567688 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 447/889] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:19 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:20.375591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-98a63aec-df56-4aae-bb45-7615759d57eb req-ba9b8916-4113-473d-9d45-0226a71894c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0867b09-cad0-497b-b0ec-15092faf6e1c", "name": "network-vif-deleted", "tag": "922a4b3f-f7ee-436d-8411-f2e3508ed3d3"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:35:20.388994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-98a63aec-df56-4aae-bb45-7615759d57eb req-ba9b8916-4113-473d-9d45-0226a71894c2 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:20.389470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-98a63aec-df56-4aae-bb45-7615759d57eb req-ba9b8916-4113-473d-9d45-0226a71894c2 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:20.390024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-98a63aec-df56-4aae-bb45-7615759d57eb req-ba9b8916-4113-473d-9d45-0226a71894c2 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:20.402806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-98a63aec-df56-4aae-bb45-7615759d57eb req-ba9b8916-4113-473d-9d45-0226a71894c2 service nova] Creating event network-vif-deleted:922a4b3f-f7ee-436d-8411-f2e3508ed3d3 for instance c0867b09-cad0-497b-b0ec-15092faf6e1c on hv-cinder-84890 Aug 24 15:35:20.408764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-98a63aec-df56-4aae-bb45-7615759d57eb req-ba9b8916-4113-473d-9d45-0226a71894c2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036940 Aug 24 15:35:20.411013 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 443/890] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:20.587712 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:20.588331 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:20.594739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:20.595307 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:20.595645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:20.596419 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:20.596807 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:20.597235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:20.630544 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:20.631030 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:20.631471 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:20.631917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lazy-loading 'fault' on Instance uuid c0867b09-cad0-497b-b0ec-15092faf6e1c {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:35:20.674212 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:20.681791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6e66d13b-c5a2-4854-827b-d9476d0a3d7d tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 200 len: 1336 microversion: 2.1 time: 0.097917 Aug 24 15:35:20.682374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 448/891] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:20 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:21.703265 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:21.703958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: c0867b09-cad0-497b-b0ec-15092faf6e1c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:21.710484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:21.710960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:21.711389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:21.712067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:21.712515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:21.712933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:21.726284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] HTTP exception thrown: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c could not be found. Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Request method failure captured: Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c HTTP/1.1 Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkOSc0dE1xmstci05otrZ4SP53WpoaOzS1Ogt7qYougQw2n0gIk-qn2dvMXW6wpsW7hGtRVeSwRBPOZbpZh7ufzHxLW7NWcB0n3NG1F-M-tnJTGAVtQ_jgvFGgVl2J1Vcge2SUZXR0zVL4wn80zYXRIrwoiQ929leEWqwq6YTS-oizw Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:35:21.727853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ce23bc924f714d72ad20d32a3f5b6d25", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}] Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 461b9a3987744067a62234aaa8d086d0 Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c could not be found. Aug 24 15:35:21.729501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'c0867b09-cad0-497b-b0ec-15092faf6e1c'} Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c could not be found. Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:35:21.730513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c could not be found. Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c could not be found. Aug 24 15:35:21.732155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:21.734204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Returning 404 to user: Instance c0867b09-cad0-497b-b0ec-15092faf6e1c could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:35:21.734204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7ec45219-05c9-4025-8b37-5c761b3dde29 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c" status: 404 len: 111 microversion: 2.1 time: 0.030125 Aug 24 15:35:21.734204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 444/892] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:21 2022] GET /compute/v2.1/servers/c0867b09-cad0-497b-b0ec-15092faf6e1c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:35:21.738617 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d2344668-c90f-4f62-87cb-ee66ae7b1cf3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '.version_select at 0x7f6659354ee0>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:21.757542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d2344668-c90f-4f62-87cb-ee66ae7b1cf3 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205020188" status: 202 len: 0 microversion: 2.1 time: 0.022640 Aug 24 15:35:21.758332 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 449/893] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 15:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205020188 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:35:24.622580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:24.623742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:24.630090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:24.630600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:24.631034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:24.631716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:24.632162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:24.632582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:24.656932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:35:24.729327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e2353950-6f4f-496e-8ce4-0c76177f2d9a tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "DELETE /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 204 len: 0 microversion: 2.1 time: 0.110163 Aug 24 15:35:24.730040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 445/894] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:35:24 2022] DELETE /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:35:24.739721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:24.740594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:24.747274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:24.747777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:24.748196 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:24.748886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:24.749342 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:24.749768 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:24.876154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:24.883879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0ac81df2-9f12-40bd-aed8-11cce4d34815 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1508 microversion: 2.1 time: 0.149234 Aug 24 15:35:24.884432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 450/895] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:24 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:25.860053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-7c876b13-633f-46de-b5cb-37d6f333e3f9 req-11f3e8e3-f23f-4596-a74d-cd73a31413aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906ae0b-2d03-4ffb-b754-4580ba86246d", "name": "network-vif-deleted", "tag": "6943cc7e-9b9d-44dd-bac6-c74c7014e3b5"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:35:25.870358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-7c876b13-633f-46de-b5cb-37d6f333e3f9 req-11f3e8e3-f23f-4596-a74d-cd73a31413aa service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:25.870835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-7c876b13-633f-46de-b5cb-37d6f333e3f9 req-11f3e8e3-f23f-4596-a74d-cd73a31413aa service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:25.871264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-7c876b13-633f-46de-b5cb-37d6f333e3f9 req-11f3e8e3-f23f-4596-a74d-cd73a31413aa service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:25.886623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-7c876b13-633f-46de-b5cb-37d6f333e3f9 req-11f3e8e3-f23f-4596-a74d-cd73a31413aa service nova] Creating event network-vif-deleted:6943cc7e-9b9d-44dd-bac6-c74c7014e3b5 for instance 5906ae0b-2d03-4ffb-b754-4580ba86246d on hv-cinder-84890 Aug 24 15:35:25.891638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-7c876b13-633f-46de-b5cb-37d6f333e3f9 req-11f3e8e3-f23f-4596-a74d-cd73a31413aa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035935 Aug 24 15:35:25.892089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 446/896] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:25.906136 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:25.907050 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:25.913849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:25.914384 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:25.914823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:25.915530 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:25.915988 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:25.916421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:25.984439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:25.993330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dce498a2-6e50-474f-bd62-66c39e8b4c93 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 200 len: 1293 microversion: 2.1 time: 0.091743 Aug 24 15:35:25.994389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 451/897] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:25 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:27.016327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:27.016970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: 5906ae0b-2d03-4ffb-b754-4580ba86246d] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:27.023059 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.023540 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.023973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.024656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.025104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.025526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.039408 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] HTTP exception thrown: Instance 5906ae0b-2d03-4ffb-b754-4580ba86246d could not be found. Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Request method failure captured: Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d HTTP/1.1 Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkOSc0dE1xmstci05otrZ4SP53WpoaOzS1Ogt7qYougQw2n0gIk-qn2dvMXW6wpsW7hGtRVeSwRBPOZbpZh7ufzHxLW7NWcB0n3NG1F-M-tnJTGAVtQ_jgvFGgVl2J1Vcge2SUZXR0zVL4wn80zYXRIrwoiQ929leEWqwq6YTS-oizw Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:35:27.040997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ce23bc924f714d72ad20d32a3f5b6d25", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}] Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 461b9a3987744067a62234aaa8d086d0 Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 5906ae0b-2d03-4ffb-b754-4580ba86246d could not be found. Aug 24 15:35:27.042569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '5906ae0b-2d03-4ffb-b754-4580ba86246d'} Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5906ae0b-2d03-4ffb-b754-4580ba86246d could not be found. Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:35:27.043484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5906ae0b-2d03-4ffb-b754-4580ba86246d could not be found. Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5906ae0b-2d03-4ffb-b754-4580ba86246d could not be found. Aug 24 15:35:27.045611 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:27.046850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Returning 404 to user: Instance 5906ae0b-2d03-4ffb-b754-4580ba86246d could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:35:27.046850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a98eaa9f-3935-49a7-ab88-116dd1025f9b tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d" status: 404 len: 111 microversion: 2.1 time: 0.030816 Aug 24 15:35:27.046850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 447/898] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:27 2022] GET /compute/v2.1/servers/5906ae0b-2d03-4ffb-b754-4580ba86246d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:35:27.051552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:27.052058 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:27.058462 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.058954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.059390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.060095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.060558 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.061037 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.085066 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:35:27.161097 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-03edf1c7-31b4-4eeb-8f75-6666dd23ea21 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 204 len: 0 microversion: 2.1 time: 0.112907 Aug 24 15:35:27.161987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 452/899] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:35:27 2022] DELETE /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:35:27.170655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:27.171353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:27.177299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.177780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.178232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.178922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:27.179373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:27.179796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:27.311450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:27.319082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e9ba97e9-48a1-4966-8645-59b0e1b74418 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.152875 Aug 24 15:35:27.319637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 448/900] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:27 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:28.340615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:28.341383 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:28.344275 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:28.349615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:28.350042 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:28.350517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:28.351220 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:28.351682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:28.352112 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:28.484410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:28.492306 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-693e41f1-01f7-4fc3-969c-199201b9d1bb tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.155919 Aug 24 15:35:28.492864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 453/901] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:28 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:29.512883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:29.513512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:29.516086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:29.523040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:29.523637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:29.524091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:29.524819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:29.525278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:29.525708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:29.531971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:29.668104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461b9a3987744067a62234aaa8d086d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce23bc924f714d72ad20d32a3f5b6d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:29.675994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ced31c99-2a50-4ee0-8335-fcb6f156f712 tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 200 len: 1523 microversion: 2.1 time: 0.166905 Aug 24 15:35:29.676579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 449/902] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:29 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:29.847064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-5c00cbab-e3fc-4e5e-93a0-44b851b4fa87 req-40079bcd-d67f-4feb-91f8-1625a43b0caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f66ab1-18d5-41d8-b752-d6a00fd893b4", "name": "network-vif-deleted", "tag": "a94c617a-233e-4bf8-b514-c995148f2911"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:35:29.857821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5c00cbab-e3fc-4e5e-93a0-44b851b4fa87 req-40079bcd-d67f-4feb-91f8-1625a43b0caa service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:29.858343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5c00cbab-e3fc-4e5e-93a0-44b851b4fa87 req-40079bcd-d67f-4feb-91f8-1625a43b0caa service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:29.858787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-5c00cbab-e3fc-4e5e-93a0-44b851b4fa87 req-40079bcd-d67f-4feb-91f8-1625a43b0caa service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:29.870022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-5c00cbab-e3fc-4e5e-93a0-44b851b4fa87 req-40079bcd-d67f-4feb-91f8-1625a43b0caa service nova] Creating event network-vif-deleted:a94c617a-233e-4bf8-b514-c995148f2911 for instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 on hv-cinder-84890 Aug 24 15:35:29.875083 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-5c00cbab-e3fc-4e5e-93a0-44b851b4fa87 req-40079bcd-d67f-4feb-91f8-1625a43b0caa service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Aug 24 15:35:29.875670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 454/903] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:35:30.695478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:30.696087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] [instance: e9f66ab1-18d5-41d8-b752-d6a00fd893b4] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:30.702535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:30.703053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:30.703488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:30.704167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:30.704617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:30.705039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:30.718426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] HTTP exception thrown: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 could not be found. Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Request method failure captured: Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 HTTP/1.1 Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkOSc0dE1xmstci05otrZ4SP53WpoaOzS1Ogt7qYougQw2n0gIk-qn2dvMXW6wpsW7hGtRVeSwRBPOZbpZh7ufzHxLW7NWcB0n3NG1F-M-tnJTGAVtQ_jgvFGgVl2J1Vcge2SUZXR0zVL4wn80zYXRIrwoiQ929leEWqwq6YTS-oizw Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:35:30.719908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ce23bc924f714d72ad20d32a3f5b6d25", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ce23bc924f714d72ad20d32a3f5b6d25"}]}] Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ce23bc924f714d72ad20d32a3f5b6d25 Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1293123024 Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 461b9a3987744067a62234aaa8d086d0 Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1293123024-project Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 could not be found. Aug 24 15:35:30.721474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'e9f66ab1-18d5-41d8-b752-d6a00fd893b4'} Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 could not be found. Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:35:30.722423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 could not be found. Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 could not be found. Aug 24 15:35:30.723933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:35:30.725473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] Returning 404 to user: Instance e9f66ab1-18d5-41d8-b752-d6a00fd893b4 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:35:30.725473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-71acaeff-b673-45ca-82f2-21680449fa7e tempest-ServerRescueNegativeTestJSON-1293123024 tempest-ServerRescueNegativeTestJSON-1293123024-project] 10.222.0.76 "GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4" status: 404 len: 111 microversion: 2.1 time: 0.029672 Aug 24 15:35:30.725473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 450/904] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:30 2022] GET /compute/v2.1/servers/e9f66ab1-18d5-41d8-b752-d6a00fd893b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:35:48.445436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:48.446116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:48.448881 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:48.449637 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:48.456044 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:48.456528 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:48.457012 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:48.457725 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:48.458181 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:48.458632 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:48.483658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-735318a3-5948-49e3-9d67-000a7882b13f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/ips" status: 200 len: 152 microversion: 2.20 time: 0.043202 Aug 24 15:35:48.484233 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 455/905] 10.222.0.76 () {60 vars in 1289 bytes} [Wed Aug 24 15:35:48 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:35:50.298869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:35:50.299607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:50.302559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:50.303189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=7 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:35:50.306767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:50.307285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:50.307756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:50.308456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:50.308916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:50.309394 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:50.332597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lazy-loading 'flavor' on Instance uuid 50a3e7b0-42df-4c5b-8695-94b3818d8461 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:35:50.516757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-74691bad-3071-4b91-8fae-b6f71e5b8521 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/action" status: 202 len: 0 microversion: 2.20 time: 0.222298 Aug 24 15:35:50.517583 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 451/906] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 15:35:50 2022] POST /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:35:50.525623 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:50.526289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:50.533602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:50.535318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:50.535922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:50.536996 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:50.537464 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:50.537900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:50.739986 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:50.749844 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:50.751398 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:50.752782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-8fff3ce1-c9e8-421b-8340-24b8af73e10c tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.231108 Aug 24 15:35:50.753352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 456/907] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:50 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:51.777553 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:51.778895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:51.786274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:51.786522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:51.787322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:51.787730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:51.788173 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:51.788592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:51.934741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:51.945199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:51.946736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:51.948183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-91a3d12c-8182-4c18-9e88-cf699a0d842b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.175415 Aug 24 15:35:51.949266 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 452/908] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:51 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:52.069534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:35:52.070323 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:52.077726 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:52.078213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:52.078678 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:52.079388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:52.079841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:52.080265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:52.105439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lazy-loading 'flavor' on Instance uuid 70d17656-4032-4d35-a9d6-975873d58c29 {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:35:52.184951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-82ea4965-f085-4dda-9782-f552fc066871 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "POST /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29/action" status: 202 len: 0 microversion: 2.1 time: 0.120266 Aug 24 15:35:52.186143 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 457/909] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:35:52 2022] POST /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:35:52.199586 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:52.201474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:52.209124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:52.209646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:52.211216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:52.213178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:52.213178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:52.213529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:52.389873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:52.397991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9af5b3ef-9f20-4b6b-90d5-ff54678114d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.207013 Aug 24 15:35:52.398601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 453/910] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:52 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:52.972681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:52.973510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:52.979859 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:52.980347 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:52.980783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:52.982073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:52.982563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:52.982985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:53.185455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:53.193748 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:53.195495 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:53.197300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c13ab98b-60fd-4b60-8bbf-60c93373cda9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.229354 Aug 24 15:35:53.197854 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 458/911] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:52 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:53.423272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:53.424433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:53.433564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:53.434206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:53.434738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:53.435635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:53.436413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:53.437055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:53.594341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:53.603080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fc7c7571-e14e-46f6-bafc-b34165173a5a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.185839 Aug 24 15:35:53.603669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 454/912] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:53 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:54.220998 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:54.221567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:54.228106 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:54.228589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:54.229021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:54.229713 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:54.230162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:54.230605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:54.364690 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:54.375652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:54.377158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:54.378366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dda5f3d9-aba7-45ec-9da8-7cb5b3bccb00 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.161688 Aug 24 15:35:54.378929 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 459/913] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:54 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:54.626053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:54.626707 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:54.633192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:54.633681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:54.634120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:54.634846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:54.635301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:54.635726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:54.776833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:54.786062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fcced02f-a320-4ff9-9d1d-ad6a78199aba tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.164411 Aug 24 15:35:54.786725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 455/914] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:54 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:35:55.400985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:55.401594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:55.408389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:55.408870 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:55.409306 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:55.410300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:55.410788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:55.411200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:55.552112 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:55.561017 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:55.562546 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:55.563720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-dc09be24-8529-4dd4-b822-1fad422d32ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.166597 Aug 24 15:35:55.564309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 460/915] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:55 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:55.807993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:55.808548 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:55.815478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:55.815974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:55.816396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:55.817081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:55.817532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:55.817954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:55.948798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:55.956873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7f36bd42-0425-4756-8a6a-a3f4c40e06e9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.152888 Aug 24 15:35:55.957440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 456/916] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:55 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:56.587848 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:56.588470 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:56.596090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:56.598129 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:56.598602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:56.599315 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:56.600033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:56.600685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:56.755744 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:56.764239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:56.765834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:56.767275 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-13c3e480-d5cf-48b2-ad12-625a22e2b738 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.183447 Aug 24 15:35:56.767874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 461/917] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:56 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:35:56.976812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:56.977475 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:56.984442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:56.984923 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:56.985357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:56.986658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:56.986779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:56.987141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:57.121507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:57.129277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d474c69f-e80d-4d18-9900-bc2958c05a8c tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.156212 Aug 24 15:35:57.129840 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 457/918] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:56 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:57.790010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:57.790658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:57.797862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:57.798395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:57.798839 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:57.799557 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:57.800156 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:57.800651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:57.951148 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:57.963031 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:57.964651 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:57.966395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-51e92437-31d7-4f71-8a3b-905b0004ada0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.180321 Aug 24 15:35:57.966938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 462/919] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:57 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:58.151782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:58.152649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:58.161117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:58.161596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:58.162028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:58.162738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:58.163184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:58.163601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:58.303282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:58.311248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5cd7bf0b-ba92-4cb5-b125-dab38794f540 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.164315 Aug 24 15:35:58.311817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 458/920] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:58 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:35:58.990806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:58.991415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:58.998728 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:58.999314 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:58.999626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:59.000319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:59.000810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:59.001234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:59.136468 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:59.145990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:59.148679 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:59.149152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ff0c6046-0c81-4241-b7a0-c66fdb584f6e tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.162137 Aug 24 15:35:59.149765 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 463/921] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:35:58 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:35:59.332906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:35:59.333580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:35:59.340452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:59.340930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:59.341365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:59.342049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:35:59.342526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:35:59.342946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:35:59.478364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:35:59.486142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-24cd3626-94d6-43af-8b45-5bdfab4afba8 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.158012 Aug 24 15:35:59.486746 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 459/922] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:35:59 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:00.174120 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:00.174761 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:00.181128 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:00.181606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:00.182040 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:00.182769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:00.183223 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:00.183649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:00.317020 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:00.325911 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:00.327533 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:00.328704 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-634c960d-b488-4107-8f76-b2eceb71e9b7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.158497 Aug 24 15:36:00.329265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 464/923] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:00 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:00.509970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:00.510613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:00.517308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:00.517955 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:00.518547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:00.519252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:00.519708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:00.520139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:00.657480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:00.666696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-caec7996-c095-4bb0-9321-a3c44d1f38be tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.163193 Aug 24 15:36:00.667261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 460/924] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:00 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:01.353016 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:01.353630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:01.360207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:01.360603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:01.361162 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:01.362410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:01.363174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:01.363836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:01.504293 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:01.513482 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:01.515078 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:01.516238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-16f58bdc-6e55-4fa3-a18d-5c1423ea70f5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.167186 Aug 24 15:36:01.516871 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 465/925] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:01 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:01.688458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:01.689321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:01.695760 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:01.696242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:01.696676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:01.697372 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:01.697827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:01.698342 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:01.852752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:01.861409 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a3c54f6e-26d6-4a76-8a1e-e3ee5c767cb4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.177623 Aug 24 15:36:01.862001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 461/926] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:01 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:02.540903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:02.541663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:02.550093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:02.550613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:02.551052 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:02.551790 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:02.552245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:02.552670 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:02.746609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:02.755722 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:02.757222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:02.758445 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-df7500fd-e8ff-4e53-99eb-c76b640c176f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1745 microversion: 2.20 time: 0.222195 Aug 24 15:36:02.758996 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 466/927] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:02 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:02.883670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:02.884279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:02.890906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:02.891381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:02.891809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:02.892494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:02.892936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:02.893351 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:03.045558 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:03.054369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-982c41eb-817f-4d07-b308-6d0bbd9b59df tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.174602 Aug 24 15:36:03.055733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 462/928] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:02 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:03.782242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:03.782954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:03.789883 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:03.790401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:03.790838 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:03.791525 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:03.792000 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:03.792392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:03.928509 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:03.937539 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:03.939089 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:03.940743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7a434daa-cfda-4274-ac61-9cca48b9b6bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1745 microversion: 2.20 time: 0.162014 Aug 24 15:36:03.950360 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 467/929] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:03 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:04.077656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:04.078190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:04.084515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:04.084998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:04.085437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:04.086120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:04.086599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:04.087021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:04.217513 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:04.227245 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1adfa5a3-66c1-42f1-997e-c4968432c57f tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.154070 Aug 24 15:36:04.227970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 463/930] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:04 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:04.964950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:04.967421 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:04.985173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Traceback (most recent call last): Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: timer() Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: cb(*args, **kw) Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: waiter.switch() Aug 24 15:36:04.985356 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: greenlet.error: cannot switch to a different thread Aug 24 15:36:04.990463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:04.991079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:04.991602 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:04.992413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:04.992865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:04.993330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:05.128598 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:05.137032 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:05.138571 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:05.139727 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6695a1e5-e800-4dda-a96d-6a6218ddb617 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1745 microversion: 2.20 time: 0.178658 Aug 24 15:36:05.140281 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 468/931] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:04 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:05.222600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-484422cf-d009-437b-b9bd-94350f4ad5d7 req-22783423-a025-4758-8b45-b0579272774f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "name": "network-vif-plugged", "status": "completed", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:05.233591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-484422cf-d009-437b-b9bd-94350f4ad5d7 req-22783423-a025-4758-8b45-b0579272774f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:05.234251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-484422cf-d009-437b-b9bd-94350f4ad5d7 req-22783423-a025-4758-8b45-b0579272774f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:05.234777 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-484422cf-d009-437b-b9bd-94350f4ad5d7 req-22783423-a025-4758-8b45-b0579272774f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:05.246154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-484422cf-d009-437b-b9bd-94350f4ad5d7 req-22783423-a025-4758-8b45-b0579272774f service nova] Creating event network-vif-plugged:fbe0cd2d-eada-4502-bc94-eb462c1463d7 for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 on hv-cinder-84890 Aug 24 15:36:05.249150 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:05.250277 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:05.257207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-484422cf-d009-437b-b9bd-94350f4ad5d7 req-22783423-a025-4758-8b45-b0579272774f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038374 Aug 24 15:36:05.257952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 464/932] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:36:05.259524 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:05.260262 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:05.260951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:05.261663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:05.262118 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:05.262563 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:05.403256 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:05.406791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:05.412209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-557e3887-172b-428d-8ab3-11aa124a7841 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.167501 Aug 24 15:36:05.412775 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 469/933] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:05 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:36:06.163000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:06.163663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:06.170458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.171177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.171615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.172312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.172762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.173188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.308130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:06.316217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:06.317738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:06.318929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8f44afd4-e945-48d5-b37d-44b04b7c006b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1745 microversion: 2.20 time: 0.160588 Aug 24 15:36:06.319495 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 465/934] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:06 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:06.433266 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:06.433910 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:06.442191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.442720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.443160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.443872 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.444340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.444776 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.589428 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:06.597577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1bc9f041-fc14-4da0-9993-fa006fa2cf2b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1569 microversion: 2.1 time: 0.168502 Aug 24 15:36:06.598151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 470/935] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:06 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:06.618337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:06.618934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:06.624967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.625454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.625895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.626671 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.627130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.627562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.631455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:06.677775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120849) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:36:06.746423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d548ff81-2d94-4fb9-a647-4b76cb3b1533 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "POST /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29/action" status: 202 len: 0 microversion: 2.1 time: 0.132012 Aug 24 15:36:06.747130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 466/936] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:36:06 2022] POST /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:36:06.755472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:06.756094 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:06.762871 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.763367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.763811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.764510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:06.764990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:06.765422 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:06.919498 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:06.931157 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f7d138e0-0998-4fe4-b0a9-7b76771c82a9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1517 microversion: 2.1 time: 0.179626 Aug 24 15:36:06.932598 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 471/937] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:06 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:07.343303 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:07.343912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:07.350901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:07.351440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:07.352090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:07.352793 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:07.353238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:07.353651 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:07.486918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:07.496061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:07.498088 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:07.499301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7263ad97-96b0-41af-9d1f-cdfcdd5eb6ee tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1745 microversion: 2.20 time: 0.161334 Aug 24 15:36:07.499839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 467/938] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:07 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:07.952845 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:07.953776 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:07.960783 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:07.961599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:07.962034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:07.962766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:07.963216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:07.963797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:08.120336 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:08.129165 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c8f44c60-fe54-4647-8d97-7b13e87e39a0 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1519 microversion: 2.1 time: 0.180321 Aug 24 15:36:08.129836 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 472/939] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:07 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:08.525443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:08.526755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:08.534672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:08.536010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:08.536616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:08.537640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:08.538257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:08.538846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:08.715746 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:08.725566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:08.727713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:08.729177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-56501413-6d49-4ea4-8133-7376e533eced tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.207787 Aug 24 15:36:08.730023 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 468/940] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:08 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:09.152658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:09.153410 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:09.167677 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:09.170471 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:09.171729 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:09.172479 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:09.172950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:09.173381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:09.329748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-36eec248-dfc7-4b92-b556-55664c03d8cf req-8d7e8002-04a9-4869-acf4-196cac2fb527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "name": "network-vif-unplugged", "status": "completed", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:09.339905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-36eec248-dfc7-4b92-b556-55664c03d8cf req-8d7e8002-04a9-4869-acf4-196cac2fb527 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:09.340677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-36eec248-dfc7-4b92-b556-55664c03d8cf req-8d7e8002-04a9-4869-acf4-196cac2fb527 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:09.341431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-36eec248-dfc7-4b92-b556-55664c03d8cf req-8d7e8002-04a9-4869-acf4-196cac2fb527 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:09.354737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-36eec248-dfc7-4b92-b556-55664c03d8cf req-8d7e8002-04a9-4869-acf4-196cac2fb527 service nova] Creating event network-vif-unplugged:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:36:09.363994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-36eec248-dfc7-4b92-b556-55664c03d8cf req-8d7e8002-04a9-4869-acf4-196cac2fb527 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038244 Aug 24 15:36:09.364988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 469/941] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:36:09.757936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:09.759091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:09.772648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:09.773164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:09.773437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:09.774144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:09.774702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:09.775104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:09.816209 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:09.827599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c2524af4-9be7-4796-b691-ec62e9739c0a tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.680266 Aug 24 15:36:09.830055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 473/942] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:09 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:09.993021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:10.002884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:10.004827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:10.006294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f7f13210-7c97-46b0-a5ac-580c597a02f9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.254306 Aug 24 15:36:10.026658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 470/943] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:09 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:10.862971 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:10.864805 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:10.876905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:10.877779 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:10.878696 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:10.879736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:10.880928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:10.881975 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:11.039206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:11.040562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:11.052487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:11.052983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:11.055537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:11.056280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:11.059000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:11.059666 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:11.113255 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:11.123373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-78801d81-58ed-40da-bc39-ad30c4264856 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.269812 Aug 24 15:36:11.124334 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 474/944] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:10 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:11.320899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:11.332106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:11.333882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:11.335085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e7736545-79e8-4d4a-92cc-1f8bec126ee1 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.300894 Aug 24 15:36:11.335805 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 471/945] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:11 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:12.148606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:12.149834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:12.158567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:12.159380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:12.160950 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:12.161898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:12.162589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:12.163119 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:12.336122 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:12.346803 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7578b0c3-7975-4059-905f-7858240028b7 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.205702 Aug 24 15:36:12.347614 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 475/946] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:12 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:12.359566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:12.360169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:12.373230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:12.374185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:12.374661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:12.375377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:12.375828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:12.376317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:12.528816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:12.539208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:12.540926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:12.542334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a9cc2f13-23ac-4972-a1d6-acb22bb2b8e5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.187257 Aug 24 15:36:12.543599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 472/947] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:12 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:13.375862 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:13.376487 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:13.384059 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:13.384920 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:13.385366 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:13.386098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:13.387107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:13.387564 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:13.557302 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:13.568383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:13.569403 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-fda54c36-6011-4870-94a3-51438524bb26 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.203820 Aug 24 15:36:13.570195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:13.571204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 476/948] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:13 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:13.580423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:13.581130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:13.581736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:13.583058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:13.583647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:13.584371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:13.745747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:13.758189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:13.760759 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:13.762477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-11468507-a3b2-4e10-bd54-a5f32cbcfd98 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.199350 Aug 24 15:36:13.763522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 473/949] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:13 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:14.603200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:14.603850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:14.611108 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:14.611589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:14.612019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:14.612772 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:14.613247 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:14.613663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:14.777194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:14.786711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:14.787993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:14.796681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-755ac850-79be-464b-8103-3cc197f3c2d9 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.201779 Aug 24 15:36:14.797971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:14.798464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:14.798900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:14.799549 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:14.800059 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:14.800615 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:14.812049 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 477/950] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:14 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:14.970606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:14.979365 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:14.981283 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:14.982566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a5ff8952-4001-49da-86a2-aad3793b76fc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.200458 Aug 24 15:36:14.986570 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 474/951] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:14 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:15.821011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:15.821835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:15.830114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:15.830788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:15.831498 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:15.832457 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:15.833095 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:15.833673 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:15.988739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:15.998079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3a2b83f9-28cd-4aa8-b80d-1d78082e83d4 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.181586 Aug 24 15:36:15.998771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 478/952] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:15 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:36:16.009121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:16.009865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:16.018780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:16.019631 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:16.020313 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:16.021243 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:16.021905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:16.022480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:16.175736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:16.186249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:16.187888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:16.189314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0487adeb-bb23-4c23-8189-6f5f786387d0 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.184191 Aug 24 15:36:16.189962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 475/953] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:16 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:17.035906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:17.035906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:17.056019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:17.056514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:17.056996 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:17.057891 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:17.068146 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:17.068764 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:17.216157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:17.217131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:17.225660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:17.226304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:17.227260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:17.228458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:17.228989 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:17.229623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:17.348839 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:17.357987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e51bf8d8-baa7-440c-aa37-0eee55febf17 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.339003 Aug 24 15:36:17.358955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 479/954] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:17 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:17.398858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:17.412481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:17.415949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:17.417455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fcb6ce7c-e138-44ed-bc4a-116a22d41142 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.206383 Aug 24 15:36:17.424075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 476/955] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:17 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:18.378991 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:18.379664 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:18.385634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:18.386117 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:18.386629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:18.387326 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:18.387782 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:18.388242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:18.445086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:18.446466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:18.453126 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:18.453853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:18.454509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:18.455208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:18.456012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:18.456443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:18.545000 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:18.556922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-98539e55-67af-44fa-a287-6dc9e95feb44 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1575 microversion: 2.1 time: 0.182041 Aug 24 15:36:18.557775 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 480/956] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:18 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:18.599030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:18.613140 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:18.616057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:18.618117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7b969479-7af5-4b9a-a71b-53da35b6e7aa tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1740 microversion: 2.20 time: 0.177616 Aug 24 15:36:18.619301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 477/957] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:18 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:19.580506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:19.581242 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:19.584425 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=53 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:19.591976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:19.591976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:19.591976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:19.591976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:19.592484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:19.592484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:19.643193 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:19.643895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:19.650556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:19.651123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:19.651632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:19.652411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:19.652951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:19.653562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:19.806235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:19.813569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:19.822781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:19.823134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-06791be9-855f-4abb-b525-81b7f7c2f4c3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1562 microversion: 2.1 time: 0.246267 Aug 24 15:36:19.824847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:19.825319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 481/958] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:36:19 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:36:19.831690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7c2092fc-b205-4014-b3b2-1792004ca6da tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1722 microversion: 2.20 time: 0.192303 Aug 24 15:36:19.832808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 478/959] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:19 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:20.856370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:20.856923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:20.863253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:20.863733 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:20.864396 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:20.865110 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:20.865561 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:20.865985 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:21.004169 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:21.012455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:21.013955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:21.015149 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ee901e0f-695f-4b61-a19b-cca1e415fd33 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1722 microversion: 2.20 time: 0.163291 Aug 24 15:36:21.015707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 482/960] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:20 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:21.337618 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-231de9eb-a94d-4e1b-bb0f-0406fd1a93e0 req-39be1aba-88be-4f37-ae33-eb1b8c74bbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "name": "network-vif-plugged", "status": "completed", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:21.343691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:21.350039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-231de9eb-a94d-4e1b-bb0f-0406fd1a93e0 req-39be1aba-88be-4f37-ae33-eb1b8c74bbdd service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:21.350551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-231de9eb-a94d-4e1b-bb0f-0406fd1a93e0 req-39be1aba-88be-4f37-ae33-eb1b8c74bbdd service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:21.351007 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-231de9eb-a94d-4e1b-bb0f-0406fd1a93e0 req-39be1aba-88be-4f37-ae33-eb1b8c74bbdd service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:21.363354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-231de9eb-a94d-4e1b-bb0f-0406fd1a93e0 req-39be1aba-88be-4f37-ae33-eb1b8c74bbdd service nova] Creating event network-vif-plugged:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:36:21.368414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-231de9eb-a94d-4e1b-bb0f-0406fd1a93e0 req-39be1aba-88be-4f37-ae33-eb1b8c74bbdd service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034517 Aug 24 15:36:21.369012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 479/961] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:36:22.038772 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:22.039973 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:22.046772 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.047256 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.047695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.048398 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.048856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.049284 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.184374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:22.193251 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:22.194987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:22.196172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4212e671-6253-4b00-922c-238a4dd78f14 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1725 microversion: 2.20 time: 0.161622 Aug 24 15:36:22.196726 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 483/962] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:22 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:22.220356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0d0cbe8-4d0f-4c8b-ab2f-042a2a2e23f8"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:22.222811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:22.229166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.229656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.230125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.230846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.231334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.231777 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.512521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:22.520277 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-dfe82cad-0ad6-455d-ade8-d648c048d8eb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304360 Aug 24 15:36:22.520885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 480/963] 10.222.0.76 () {62 vars in 1364 bytes} [Wed Aug 24 15:36:22 2022] POST /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 15:36:22.651510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:22.652091 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:22.658372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.658802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.659236 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.660194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.660652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.661073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.884243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:36:22.907630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-28c0c623-ddc0-482b-b9a2-1a13cc64873f tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-volume_attachments/e0d0cbe8-4d0f-4c8b-ab2f-042a2a2e23f8" status: 202 len: 0 microversion: 2.20 time: 0.260472 Aug 24 15:36:22.908255 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 484/964] 10.222.0.76 () {60 vars in 1457 bytes} [Wed Aug 24 15:36:22 2022] DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-volume_attachments/e0d0cbe8-4d0f-4c8b-ab2f-042a2a2e23f8 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:36:22.971414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:22.972112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:22.981043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.981529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.982071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:22.982851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:22.983415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:22.983789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:23.020019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120849) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 15:36:23.087614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6c8d6581-9635-4294-adb9-c7f89c2d2a4d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "POST /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/action" status: 202 len: 0 microversion: 2.20 time: 0.121084 Aug 24 15:36:23.088217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 481/965] 10.222.0.76 () {62 vars in 1319 bytes} [Wed Aug 24 15:36:22 2022] POST /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:36:23.096523 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:23.097274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:23.104304 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:23.105821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:23.105821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:23.106490 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:23.106963 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:23.107373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:23.288246 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:23.297361 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:23.299148 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:23.300327 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6f0dd3aa-ff9d-443a-9f4e-0f2bcb64dcb3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1673 microversion: 2.20 time: 0.207766 Aug 24 15:36:23.300896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 485/966] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:23 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1673 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:23.399877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-db20d05b-a997-4d5e-929b-d6b78d85c37e req-b5b364c8-395a-47b2-8f19-85f0d84c5afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "name": "network-vif-unplugged", "status": "completed", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:23.415324 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-db20d05b-a997-4d5e-929b-d6b78d85c37e req-b5b364c8-395a-47b2-8f19-85f0d84c5afe service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:23.416090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-db20d05b-a997-4d5e-929b-d6b78d85c37e req-b5b364c8-395a-47b2-8f19-85f0d84c5afe service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:23.416676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-db20d05b-a997-4d5e-929b-d6b78d85c37e req-b5b364c8-395a-47b2-8f19-85f0d84c5afe service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:23.429682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.compute.server_external_events [req-db20d05b-a997-4d5e-929b-d6b78d85c37e req-b5b364c8-395a-47b2-8f19-85f0d84c5afe service nova] Unable to find a host for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461. Dropping event network-vif-unplugged {{(pid=120849) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 15:36:23.430597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-db20d05b-a997-4d5e-929b-d6b78d85c37e req-b5b364c8-395a-47b2-8f19-85f0d84c5afe service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035031 Aug 24 15:36:23.431306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 482/967] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 15:36:24.322582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:24.323198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:24.330650 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:24.330956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:24.331582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:24.332443 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:24.333064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:24.333658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:24.557473 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:24.567265 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:24.568990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:24.570170 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c093a3ba-84aa-4c9e-84c9-cd1840f8eeb7 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.251777 Aug 24 15:36:24.570977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 486/968] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:24 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:25.596273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:25.596978 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:25.612731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:25.613843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:25.614720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:25.617520 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:25.619385 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:25.620426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:26.064851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:26.073861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:26.079676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:26.081863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8b35b6a0-54c4-474e-af8c-67170dc888cf tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.490063 Aug 24 15:36:26.088681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 483/969] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:25 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:27.111942 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:27.112743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:27.119628 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:27.120194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:27.121168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:27.122014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:27.122500 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:27.122922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:27.340194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:27.351196 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:27.353099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:27.354665 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e1c51632-6c3e-44ec-8d23-4daa5c209f72 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.246945 Aug 24 15:36:27.355873 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 487/970] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:27 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:28.382646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:28.383603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:28.391259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:28.391631 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:28.392259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:28.392958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:28.393469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:28.393891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:28.697093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:28.712793 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:28.714874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:28.716191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c57fcb36-041a-4bee-9f2a-50f3c50eeeeb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.337402 Aug 24 15:36:28.716835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 484/971] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:28 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:29.740930 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:29.741517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:29.748154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:29.748633 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:29.749067 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:29.749757 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:29.750206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:29.750778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:29.889634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:29.897823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:29.899386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:29.900545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a4e2a03e-dedb-49e4-8ce6-acacfbe4cd71 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.163570 Aug 24 15:36:29.901103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 488/972] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:29 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:30.926526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:30.927493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:30.937369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:30.937871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:30.938360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:30.939059 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:30.939519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:30.939954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:31.082580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:31.091767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:31.093276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:31.094487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e53e5afa-60d6-401e-8774-712b06702b32 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.173994 Aug 24 15:36:31.095227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 485/973] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:30 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 15:36:32.117158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:32.117716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:32.124847 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:32.125335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:32.125781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:32.126506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:32.126963 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:32.127393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:32.262590 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:32.271150 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:32.272649 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:32.273816 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-894906a0-55f2-43e4-bdba-a1d0b610066b tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.160722 Aug 24 15:36:32.274397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 489/974] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:32 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:33.428952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:33.429563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:33.435640 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:33.436124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:33.436571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:33.437260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:33.437713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:33.438139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:33.573066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:33.581252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:33.582779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:33.583938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d2f8db76-b97f-44d0-9d56-cfd3640ad22a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.288826 Aug 24 15:36:33.584578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 486/975] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:33 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:34.607797 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:34.608486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:34.615224 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:34.615714 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:34.616152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:34.616956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:34.617409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:34.617837 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:34.765514 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:34.773937 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:34.775486 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:34.777388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-66562ef1-d027-4e6d-8363-8aca5ef0c87a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.173333 Aug 24 15:36:34.783437 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 490/976] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:34 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:35.806964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:35.807670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:35.815221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:35.815657 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:35.816096 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:35.816800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:35.817251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:35.817811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:35.973125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:35.982441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:35.984257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:35.985619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2927606c-cf32-43fd-a5fe-627df97d89bb tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.182750 Aug 24 15:36:36.005258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 487/977] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:35 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:37.013238 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:37.013923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:37.020010 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:37.020497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:37.020936 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:37.021630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:37.022087 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:37.022545 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:37.160807 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:37.170140 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:37.171821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:37.172834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-700a0c84-8061-44cb-99ec-0dccbc84c1cc tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.164384 Aug 24 15:36:37.173391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 491/978] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:37 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:38.209057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:38.209650 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:38.216074 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:38.216591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:38.217025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:38.217722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:38.218184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:38.218626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:38.357157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:38.365792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:38.367359 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:38.368525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b3b06d19-5204-46f7-9a9e-6ee16a41e7fd tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.163416 Aug 24 15:36:38.369070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 488/979] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:38 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:39.392892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:39.393446 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:39.399873 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:39.400349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:39.400780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:39.401466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:39.401915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:39.402363 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:39.537938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:39.546653 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:39.548154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:39.549319 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f2f9e901-a7e5-4239-b6eb-16bd677a20ad tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.160441 Aug 24 15:36:39.549943 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 492/980] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:39 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:40.573149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:40.573787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:40.579786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:40.580271 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:40.580711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:40.581438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:40.581892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:40.582354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:40.708678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:40.717364 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:40.718902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:40.720062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-33b8be50-f817-4af9-a873-6f305b49d4b5 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.150985 Aug 24 15:36:40.720612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 489/981] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:40 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:41.743188 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:41.743787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:41.750253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:41.750740 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:41.751173 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:41.751865 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:41.752318 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:41.752742 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:41.883370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:41.892235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:41.893775 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:41.895027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-32b8d4a5-9602-4565-b2ff-a17d4ba70206 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.155788 Aug 24 15:36:41.895792 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 493/982] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:41 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:42.919524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:42.920143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:42.926572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:42.927060 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:42.927498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:42.928189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:42.928642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:42.929068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:43.056883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:43.064886 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:43.066416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:43.067569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1fd70113-a1ee-4284-ab83-e3b897ee16ed tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.152602 Aug 24 15:36:43.068120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 490/983] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:42 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:43.457369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-ffdcbed5-938c-4ec1-943a-dc5e45751bef req-de88a0a4-e897-4a1b-af67-b019e3b5461e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "name": "network-vif-plugged", "status": "completed", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:36:43.470746 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-ffdcbed5-938c-4ec1-943a-dc5e45751bef req-de88a0a4-e897-4a1b-af67-b019e3b5461e service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:43.471299 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-ffdcbed5-938c-4ec1-943a-dc5e45751bef req-de88a0a4-e897-4a1b-af67-b019e3b5461e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:43.471930 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-ffdcbed5-938c-4ec1-943a-dc5e45751bef req-de88a0a4-e897-4a1b-af67-b019e3b5461e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:43.484278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-ffdcbed5-938c-4ec1-943a-dc5e45751bef req-de88a0a4-e897-4a1b-af67-b019e3b5461e service nova] Creating event network-vif-plugged:fbe0cd2d-eada-4502-bc94-eb462c1463d7 for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 on hv-cinder-84890 Aug 24 15:36:43.489594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-ffdcbed5-938c-4ec1-943a-dc5e45751bef req-de88a0a4-e897-4a1b-af67-b019e3b5461e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Aug 24 15:36:43.490569 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 494/984] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:36:44.090808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:44.091417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:44.098162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:44.098671 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:44.099103 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:44.100010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:44.100455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:44.100876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:44.230121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:44.238904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:44.240393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:44.241543 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0ac67d47-cefa-43cc-8bd0-bcc8d4f95fc6 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.154671 Aug 24 15:36:44.242090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 491/985] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:44 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:45.265122 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:45.265732 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:45.272471 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:45.272954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:45.273388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:45.274085 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:45.274575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:45.275000 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:45.405781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:45.414484 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:45.415990 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:45.417161 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6a2a06d8-4532-4292-a434-acd38ac0bde3 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1731 microversion: 2.20 time: 0.156992 Aug 24 15:36:45.417720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 495/986] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:45 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:36:46.441326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:36:46.441960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:36:46.449268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:46.449751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:46.450185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:46.450904 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:36:46.451386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:36:46.451811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:36:46.582573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:46.591322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:46.592815 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:36:46.594001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-11bbc0d1-345f-4654-8d51-0ee956f888f8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1718 microversion: 2.20 time: 0.156928 Aug 24 15:36:46.594579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 492/987] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:36:46 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:37:42.109595 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:42.111811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:42.114079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=29 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:42.114743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:42.121072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.121551 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.121977 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.122700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.123393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.123578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.155787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4ddc6316-16ff-4fa4-a478-4a26a31f18e8 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050662 Aug 24 15:37:42.156335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 496/988] 10.222.0.76 () {60 vars in 1343 bytes} [Wed Aug 24 15:37:42 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:37:42.217778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:42.218317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:42.220299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:42.220945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:42.227622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.228099 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.228530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.229215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.229674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.230171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.256792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:37:42.332867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f5e59801-a9d8-491a-9d26-60a3144699ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 204 len: 0 microversion: 2.20 time: 0.119159 Aug 24 15:37:42.333401 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 493/989] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 15:37:42 2022] DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 15:37:42.343603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:42.344206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:42.349963 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.350488 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.350922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.351606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:42.352060 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:42.352481 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:42.480693 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:42.490735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:42.492226 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:42.493389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7353fda4-5845-4dbc-8b83-56f305bd6806 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.154588 Aug 24 15:37:42.493944 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 497/990] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:37:42 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:37:43.516812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:43.517515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:43.524120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:43.524605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:43.525044 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:43.525734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:43.526194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:43.526652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:43.656499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:43.664911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:43.666434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:43.667587 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0a549031-a5ae-4f50-a775-59e31bee2a26 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1724 microversion: 2.20 time: 0.155187 Aug 24 15:37:43.668134 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 494/991] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:37:43 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:37:44.691166 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:44.691727 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:44.698103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:44.698625 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:44.699069 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:44.700369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:44.700828 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:44.701256 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:44.821336 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:44.831239 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:44.832662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56535a702f4344aa8a58f11406acf4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e39c6ca75a3466d93195fe245509bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:44.833869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-daaf06aa-111c-43c7-8eb6-04ae5b9be3ae tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 200 len: 1656 microversion: 2.20 time: 0.146719 Aug 24 15:37:44.834527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 498/992] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:37:44 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 15:37:44.908227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-1908d2a4-7c70-4580-a677-4cd1f6b3e63c req-42670b20-c560-4772-9e10-20999b54ce2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a3e7b0-42df-4c5b-8695-94b3818d8461", "name": "network-vif-deleted", "tag": "fbe0cd2d-eada-4502-bc94-eb462c1463d7"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:44.919325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1908d2a4-7c70-4580-a677-4cd1f6b3e63c req-42670b20-c560-4772-9e10-20999b54ce2e service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:44.919807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1908d2a4-7c70-4580-a677-4cd1f6b3e63c req-42670b20-c560-4772-9e10-20999b54ce2e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:44.920235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1908d2a4-7c70-4580-a677-4cd1f6b3e63c req-42670b20-c560-4772-9e10-20999b54ce2e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:44.932417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-1908d2a4-7c70-4580-a677-4cd1f6b3e63c req-42670b20-c560-4772-9e10-20999b54ce2e service nova] Creating event network-vif-deleted:fbe0cd2d-eada-4502-bc94-eb462c1463d7 for instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 on hv-cinder-84890 Aug 24 15:37:44.938538 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-1908d2a4-7c70-4580-a677-4cd1f6b3e63c req-42670b20-c560-4772-9e10-20999b54ce2e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033847 Aug 24 15:37:44.939353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 495/993] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:45.857553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:45.858167 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:45.864901 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.865711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.865799 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.866519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:45.866978 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:45.867401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:45.881176 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] HTTP exception thrown: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Request method failure captured: Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 HTTP/1.1 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkMpp4vAR82E6nkqzysB-1alyhIhKQVyU-aT6nHiN3W5fj1AIa_sYK2wuX0Sk26x7c2QQh4kZgZC8xCA5gAJWYAHLQVtUJ7ECpQL6TfhFORUm7N3X-U_Gn8wNZBjxYfCMd991e1Q6uydSK73gycTvh0sM0L_1XyZsVJPfhbpUAUm9Us Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:37:45.882898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e39c6ca75a3466d93195fe245509bc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}] Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 56535a702f4344aa8a58f11406acf4c9 Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:45.884449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '50a3e7b0-42df-4c5b-8695-94b3818d8461'} Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:37:45.885240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:45.886676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:45.887896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Returning 404 to user: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:37:45.887896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a53bcceb-a562-4a27-9c3f-586f18975a0a tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 404 len: 111 microversion: 2.20 time: 0.031200 Aug 24 15:37:45.887896 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 499/994] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:37:45 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:37:45.893903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cd7abb9b-fa76-4193-a959-7c8f0e031904 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '.version_select at 0x7f6659296040>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:45.917164 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cd7abb9b-fa76-4193-a959-7c8f0e031904 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162706876" status: 204 len: 0 microversion: 2.20 time: 0.027418 Aug 24 15:37:45.918028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 496/995] 10.222.0.76 () {60 vars in 1259 bytes} [Wed Aug 24 15:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162706876 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 15:37:47.687822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:47.688358 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:47.694723 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.695200 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.695630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.696312 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.696762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.697180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.710887 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] HTTP exception thrown: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Request method failure captured: Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 HTTP/1.1 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkMpp4vAR82E6nkqzysB-1alyhIhKQVyU-aT6nHiN3W5fj1AIa_sYK2wuX0Sk26x7c2QQh4kZgZC8xCA5gAJWYAHLQVtUJ7ECpQL6TfhFORUm7N3X-U_Gn8wNZBjxYfCMd991e1Q6uydSK73gycTvh0sM0L_1XyZsVJPfhbpUAUm9Us Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:37:47.712415 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e39c6ca75a3466d93195fe245509bc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}] Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 56535a702f4344aa8a58f11406acf4c9 Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.714151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '50a3e7b0-42df-4c5b-8695-94b3818d8461'} Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:37:47.714967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.716876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.718178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Returning 404 to user: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:37:47.718178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1e8dafcf-40f1-4dbf-a2db-80776f7f5d3d tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 404 len: 111 microversion: 2.20 time: 0.029797 Aug 24 15:37:47.718178 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 500/996] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 15:37:47 2022] DELETE /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:37:47.723441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:47.724174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 50a3e7b0-42df-4c5b-8695-94b3818d8461] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:47.730676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.731156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.731588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.732873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:47.732873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:47.733140 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:47.746089 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] HTTP exception thrown: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Request method failure captured: Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 HTTP/1.1 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMpp4vAR82E6nkqzysB-1alyhIhKQVyU-aT6nHiN3W5fj1AIa_sYK2wuX0Sk26x7c2QQh4kZgZC8xCA5gAJWYAHLQVtUJ7ECpQL6TfhFORUm7N3X-U_Gn8wNZBjxYfCMd991e1Q6uydSK73gycTvh0sM0L_1XyZsVJPfhbpUAUm9Us Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:37:47.747791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e39c6ca75a3466d93195fe245509bc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}] Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 56535a702f4344aa8a58f11406acf4c9 Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.749478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '50a3e7b0-42df-4c5b-8695-94b3818d8461'} Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:37:47.750537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. Aug 24 15:37:47.752040 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:47.753737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Returning 404 to user: Instance 50a3e7b0-42df-4c5b-8695-94b3818d8461 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:37:47.753737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-37ed4692-836b-4975-9ca7-36b35d0c7587 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461" status: 404 len: 111 microversion: 2.20 time: 0.030152 Aug 24 15:37:47.753737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 497/997] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:37:47 2022] GET /compute/v2.1/servers/50a3e7b0-42df-4c5b-8695-94b3818d8461 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:37:48.888685 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:48.889198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:48.895589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.896070 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.896503 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.897192 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.897648 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.898072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.911518 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] HTTP exception thrown: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Request method failure captured: Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a HTTP/1.1 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkMpp4vAR82E6nkqzysB-1alyhIhKQVyU-aT6nHiN3W5fj1AIa_sYK2wuX0Sk26x7c2QQh4kZgZC8xCA5gAJWYAHLQVtUJ7ECpQL6TfhFORUm7N3X-U_Gn8wNZBjxYfCMd991e1Q6uydSK73gycTvh0sM0L_1XyZsVJPfhbpUAUm9Us Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:37:48.913055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e39c6ca75a3466d93195fe245509bc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}] Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 56535a702f4344aa8a58f11406acf4c9 Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.914804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '0ded4f04-fa28-4ffa-9541-fc8944cbe89a'} Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:37:48.915720 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.917269 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.918931 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Returning 404 to user: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:37:48.918931 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4c0ce5a5-6aca-4beb-88c8-d3e1520ab772 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 404 len: 111 microversion: 2.20 time: 0.030245 Aug 24 15:37:48.918931 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 501/998] 10.222.0.76 () {60 vars in 1280 bytes} [Wed Aug 24 15:37:48 2022] DELETE /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:37:48.922906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:48.923528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] [instance: 0ded4f04-fa28-4ffa-9541-fc8944cbe89a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:48.929842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.930354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.930782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.931457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:48.931903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:48.932322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:48.947833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] HTTP exception thrown: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Request method failure captured: Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a HTTP/1.1 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkMpp4vAR82E6nkqzysB-1alyhIhKQVyU-aT6nHiN3W5fj1AIa_sYK2wuX0Sk26x7c2QQh4kZgZC8xCA5gAJWYAHLQVtUJ7ECpQL6TfhFORUm7N3X-U_Gn8wNZBjxYfCMd991e1Q6uydSK73gycTvh0sM0L_1XyZsVJPfhbpUAUm9Us Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:37:48.949323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_7e39c6ca75a3466d93195fe245509bc9", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/7e39c6ca75a3466d93195fe245509bc9"}]}] Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 7e39c6ca75a3466d93195fe245509bc9 Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1813613659 Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 56535a702f4344aa8a58f11406acf4c9 Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1813613659-project Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.951467 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '0ded4f04-fa28-4ffa-9541-fc8944cbe89a'} Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:37:48.952225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. Aug 24 15:37:48.953535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:37:48.954669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] Returning 404 to user: Instance 0ded4f04-fa28-4ffa-9541-fc8944cbe89a could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:37:48.954669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8a93ebca-9a24-4244-a6a2-242e42a6c8b9 tempest-AttachVolumeShelveTestJSON-1813613659 tempest-AttachVolumeShelveTestJSON-1813613659-project] 10.222.0.76 "GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a" status: 404 len: 111 microversion: 2.20 time: 0.032387 Aug 24 15:37:48.954669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 498/999] 10.222.0.76 () {60 vars in 1277 bytes} [Wed Aug 24 15:37:48 2022] GET /compute/v2.1/servers/0ded4f04-fa28-4ffa-9541-fc8944cbe89a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 15:37:57.757621 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d7cfafa2-4faf-4d89-ace2-bd6314b4e7b7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: .version_select at 0x7f66591b4430>, body: {"keypair": {"name": "tempest-keypair-734531587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5rG1za47M76pzJd+jjsJEKjETdyHFd4tHQHwlQldVjtsLYppgXegcnGjckV+6Ce14+ZcFjBgGtf4lF3lqr6zkKRbK0wxqw1Ak3f5zx7F5UoShZMfZSsIzVl6PE6wFPrw=="}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:57.774099 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-d7cfafa2-4faf-4d89-ace2-bd6314b4e7b7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for project 2839782e51514ea698132e8a290b9a20. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:57.783589 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-d7cfafa2-4faf-4d89-ace2-bd6314b4e7b7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for user 93b9cabb6bcb4141937ea814e0123bf0 and project 2839782e51514ea698132e8a290b9a20. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:57.808392 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d7cfafa2-4faf-4d89-ace2-bd6314b4e7b7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165123 Aug 24 15:37:57.809019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 502/1000] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:37:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:37:59.118472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1902354163", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d48f6cca-7726-4b32-a688-f7802fcd6c63"}], "security_groups": [{"name": "tempest-securitygroup--739716300"}], "key_name": "tempest-keypair-734531587", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:37:59.128578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:59.129323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:59.235481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] validate_networks() for [('d48f6cca-7726-4b32-a688-f7802fcd6c63', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:37:59.640781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:37:59.641229 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:37:59.641702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:37:59.642107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:37:59.642560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:37:59.651395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.651872 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.652305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:59.653533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:37:59.654029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:37:59.655184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:37:59.672065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for project 2839782e51514ea698132e8a290b9a20. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:37:59.676097 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for user 93b9cabb6bcb4141937ea814e0123bf0 and project 2839782e51514ea698132e8a290b9a20. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:37:59.688042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:37:59.690369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:37:59.752003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1aff1a9b-2927-4a76-be91-51c0a6753ee3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637766 Aug 24 15:37:59.752863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 499/1001] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:37:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:37:59.761210 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=24 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:37:59.765655 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7b0103a3-c311-4e6b-bd9c-031935b7b110 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:37:59.766290 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7b0103a3-c311-4e6b-bd9c-031935b7b110 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:37:59.827739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7b0103a3-c311-4e6b-bd9c-031935b7b110 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:37:59.835263 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7b0103a3-c311-4e6b-bd9c-031935b7b110 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1237 microversion: 2.1 time: 0.075103 Aug 24 15:37:59.835941 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 503/1002] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:37:59 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:00.856854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:00.857818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:00.864676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:00.865148 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:00.865576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.866286 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:00.866743 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:00.867162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:00.934774 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:00.948245 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6133da66-5610-4fd8-a948-102f60861ad1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1289 microversion: 2.1 time: 0.094908 Aug 24 15:38:00.949716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 500/1003] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:00 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:01.970719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:01.971364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:01.977849 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.978310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.978868 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:01.979568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:01.980027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:01.980504 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.180568 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:02.190364 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6a7db47d-a184-48e9-a2bb-4a64e4bf0497 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.223714 Aug 24 15:38:02.202270 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 504/1004] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:01 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:02.406161 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-944c0018-865d-4c29-85df-0455796dfa24 req-bea46e28-88e7-44ae-8573-981e439c3809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c998a77-4540-4b26-84ea-1e413cff031a", "tag": "6de9ed05-6896-4761-866d-74fa12f37ba4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:02.419900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-944c0018-865d-4c29-85df-0455796dfa24 req-bea46e28-88e7-44ae-8573-981e439c3809 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:02.420490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-944c0018-865d-4c29-85df-0455796dfa24 req-bea46e28-88e7-44ae-8573-981e439c3809 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:02.421148 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-944c0018-865d-4c29-85df-0455796dfa24 req-bea46e28-88e7-44ae-8573-981e439c3809 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:02.434298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-944c0018-865d-4c29-85df-0455796dfa24 req-bea46e28-88e7-44ae-8573-981e439c3809 service nova] Creating event network-changed:6de9ed05-6896-4761-866d-74fa12f37ba4 for instance 3c998a77-4540-4b26-84ea-1e413cff031a on hv-cinder-84890 Aug 24 15:38:02.439393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-944c0018-865d-4c29-85df-0455796dfa24 req-bea46e28-88e7-44ae-8573-981e439c3809 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037398 Aug 24 15:38:02.440267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 501/1005] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:03.214608 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:03.215210 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:03.222491 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.222967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.223397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.224079 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:03.224529 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:03.224952 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:03.352709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:03.360905 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-60527260-075f-4431-a48d-cf082d5468ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.150093 Aug 24 15:38:03.361458 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 505/1006] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:03 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:04.381756 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:04.382660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:04.390345 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.391072 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.391699 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.392690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.393322 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.394032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.617034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:04.624687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3c5b12e1-2ef0-4e4c-b7f4-544c38ed9d2d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.247304 Aug 24 15:38:04.625339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 502/1007] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:04 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:04.687213 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:04.687743 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:04.694906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.695400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.695984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.696850 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.697306 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.697805 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.727478 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Going to try to terminate instance {{(pid=120848) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:38:04.752469 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-29bb70e5-baf7-4b98-a237-b5fafb448a71 req-4fb35fdb-5382-40f8-8300-48643f845e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:04.762754 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-29bb70e5-baf7-4b98-a237-b5fafb448a71 req-4fb35fdb-5382-40f8-8300-48643f845e76 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.763225 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-29bb70e5-baf7-4b98-a237-b5fafb448a71 req-4fb35fdb-5382-40f8-8300-48643f845e76 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.763653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-29bb70e5-baf7-4b98-a237-b5fafb448a71 req-4fb35fdb-5382-40f8-8300-48643f845e76 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.775043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-29bb70e5-baf7-4b98-a237-b5fafb448a71 req-4fb35fdb-5382-40f8-8300-48643f845e76 service nova] Creating event network-changed:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:38:04.780960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-29bb70e5-baf7-4b98-a237-b5fafb448a71 req-4fb35fdb-5382-40f8-8300-48643f845e76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095088 Aug 24 15:38:04.781796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 503/1008] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:38:04.832139 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6bcc86d5-883f-4cd3-87b1-1c5389da20d3 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "DELETE /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 204 len: 0 microversion: 2.1 time: 0.148509 Aug 24 15:38:04.833234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 506/1009] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:38:04 2022] DELETE /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:38:04.842005 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:04.842776 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:04.849418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.849968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.850506 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.851212 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:04.851669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:04.852101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:04.995438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:05.003439 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-060059d8-28d6-44d7-bd72-7e93caecbb31 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.165886 Aug 24 15:38:05.003952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 504/1010] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:04 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:38:05.647128 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:05.647956 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:05.653922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.654467 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.654886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.655577 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:05.656027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:05.656449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:05.789856 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:05.799885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-ff206afa-95cc-4e37-80d8-64e9ba1d5657 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.157145 Aug 24 15:38:05.800463 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 507/1011] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:05 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:06.024021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:06.025566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:06.033491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.034076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.034605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.035402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.036500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.037126 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.186181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:06.194097 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2c409584-b43b-4d45-ab0f-019dc55b8b9b tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1568 microversion: 2.1 time: 0.174011 Aug 24 15:38:06.194715 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 505/1012] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:06 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:06.820699 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:06.821324 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:06.827663 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.828226 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.828668 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:06.829368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:06.830163 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:06.830634 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.062432 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:07.062658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-37bb2ce5-1ddf-4eb6-af13-70ace1725a09 req-0a9e5e8e-67bd-4359-b6f7-5c54f7bb2158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d17656-4032-4d35-a9d6-975873d58c29", "name": "network-vif-deleted", "tag": "18aedd96-0523-4ad1-a8ae-1aab12009353"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:07.071466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f11f1fb9-3d2c-49b6-b1fa-a60af22ef33f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.254837 Aug 24 15:38:07.072045 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 508/1013] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:06 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:07.073034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-37bb2ce5-1ddf-4eb6-af13-70ace1725a09 req-0a9e5e8e-67bd-4359-b6f7-5c54f7bb2158 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.073664 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-37bb2ce5-1ddf-4eb6-af13-70ace1725a09 req-0a9e5e8e-67bd-4359-b6f7-5c54f7bb2158 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.074107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-37bb2ce5-1ddf-4eb6-af13-70ace1725a09 req-0a9e5e8e-67bd-4359-b6f7-5c54f7bb2158 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.088397 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-37bb2ce5-1ddf-4eb6-af13-70ace1725a09 req-0a9e5e8e-67bd-4359-b6f7-5c54f7bb2158 service nova] Creating event network-vif-deleted:18aedd96-0523-4ad1-a8ae-1aab12009353 for instance 70d17656-4032-4d35-a9d6-975873d58c29 on hv-cinder-84890 Aug 24 15:38:07.093966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-37bb2ce5-1ddf-4eb6-af13-70ace1725a09 req-0a9e5e8e-67bd-4359-b6f7-5c54f7bb2158 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034968 Aug 24 15:38:07.094596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 506/1014] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:07.216402 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:07.217012 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:07.222918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.223397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.223830 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.224515 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.224968 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:07.225391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:07.292261 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b945e0d46946bfad2d89a0fd15fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68476a44d7ee4d1d9fbf3c7516885edf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:07.300983 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7e7ac975-ce06-4c64-9eee-7381384e5f37 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 200 len: 1219 microversion: 2.1 time: 0.088995 Aug 24 15:38:07.301588 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 509/1015] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:07 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:07.988734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-1396f3ea-f48a-45f2-b581-cbbea42f55de req-62e67438-3406-466a-b52a-be1dcd3daf53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c998a77-4540-4b26-84ea-1e413cff031a", "name": "network-vif-plugged", "status": "completed", "tag": "6de9ed05-6896-4761-866d-74fa12f37ba4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:07.999256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1396f3ea-f48a-45f2-b581-cbbea42f55de req-62e67438-3406-466a-b52a-be1dcd3daf53 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:07.999745 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1396f3ea-f48a-45f2-b581-cbbea42f55de req-62e67438-3406-466a-b52a-be1dcd3daf53 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.000146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1396f3ea-f48a-45f2-b581-cbbea42f55de req-62e67438-3406-466a-b52a-be1dcd3daf53 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.011512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-1396f3ea-f48a-45f2-b581-cbbea42f55de req-62e67438-3406-466a-b52a-be1dcd3daf53 service nova] Creating event network-vif-plugged:6de9ed05-6896-4761-866d-74fa12f37ba4 for instance 3c998a77-4540-4b26-84ea-1e413cff031a on hv-cinder-84890 Aug 24 15:38:08.016358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-1396f3ea-f48a-45f2-b581-cbbea42f55de req-62e67438-3406-466a-b52a-be1dcd3daf53 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089243 Aug 24 15:38:08.017076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 507/1016] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:08.093750 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:08.094397 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:08.100721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.101198 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.101626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.102346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.102810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.103330 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.300802 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:08.308494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2de550d8-9092-4835-baa1-a6abb53d362e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.219273 Aug 24 15:38:08.309271 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 510/1017] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:08 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:08.323457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:08.324846 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] [instance: 70d17656-4032-4d35-a9d6-975873d58c29] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:08.330938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.331416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.331849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.332527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:08.332976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:08.333400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:08.346884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] HTTP exception thrown: Instance 70d17656-4032-4d35-a9d6-975873d58c29 could not be found. Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Request method failure captured: Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 HTTP/1.1 Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkSRPmBaZLeTVUxSqGT2Q8l8gokK1BdGCaCUWMPHuysRSyLjo9LUZ9kwyN7u1UviGy9_qOBcpMPYl5mFHIWWt3AFnPV8zwtOS3wnnWNAZneISyK0ky7B3s_Sk6wk4hqV2AxrMzB-T6Hyx7nCAtBtsx6FxHTnBWLyfJqZJBbpqo88zGI Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 68476a44d7ee4d1d9fbf3c7516885edf Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestShelveInstance-168384575 Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:38:08.348472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/68476a44d7ee4d1d9fbf3c7516885edf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/68476a44d7ee4d1d9fbf3c7516885edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_68476a44d7ee4d1d9fbf3c7516885edf", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/68476a44d7ee4d1d9fbf3c7516885edf"}]}] Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestShelveInstance-168384575 Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 68476a44d7ee4d1d9fbf3c7516885edf Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestShelveInstance-168384575 Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestShelveInstance-168384575-project Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 63b945e0d46946bfad2d89a0fd15fd8c Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestShelveInstance-168384575-project Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 70d17656-4032-4d35-a9d6-975873d58c29 could not be found. Aug 24 15:38:08.350034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '70d17656-4032-4d35-a9d6-975873d58c29'} Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d17656-4032-4d35-a9d6-975873d58c29 could not be found. Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:38:08.350992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d17656-4032-4d35-a9d6-975873d58c29 could not be found. Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d17656-4032-4d35-a9d6-975873d58c29 could not be found. Aug 24 15:38:08.352472 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:38:08.353890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Returning 404 to user: Instance 70d17656-4032-4d35-a9d6-975873d58c29 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:38:08.353890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ec212487-c377-461a-9ea9-5e40dbc39b85 tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29" status: 404 len: 111 microversion: 2.1 time: 0.031033 Aug 24 15:38:08.353890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 508/1018] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:08 2022] GET /compute/v2.1/servers/70d17656-4032-4d35-a9d6-975873d58c29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:38:08.513368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f6e05adf-a971-44e9-b03d-d2fab2032d4e tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] Calling method '.version_select at 0x7f6659372040>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:08.538523 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f6e05adf-a971-44e9-b03d-d2fab2032d4e tempest-TestShelveInstance-168384575 tempest-TestShelveInstance-168384575-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-975404008" status: 202 len: 0 microversion: 2.1 time: 0.029735 Aug 24 15:38:08.539116 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 511/1019] 10.222.0.76 () {58 vars in 1251 bytes} [Wed Aug 24 15:38:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-975404008 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:38:09.330256 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:09.331204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:09.337507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:09.337989 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:09.338447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:09.339142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:09.339590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:09.340008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:09.470842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:09.478446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b1683ae8-3dfa-4125-938b-5f30536a658f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1362 microversion: 2.1 time: 0.152756 Aug 24 15:38:09.478988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 509/1020] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:09 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:10.501339 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:10.502316 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:10.504907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:10.511494 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.512888 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.513351 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.513986 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.514483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.514917 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.721152 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:38:10.729355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b232982e-cb24-47ce-9a87-7c6a133dff62 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1549 microversion: 2.1 time: 0.232314 Aug 24 15:38:10.729935 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 512/1021] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:38:10 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:38:10.751112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:38:10.751677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:38:10.753526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:10.754922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=6 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:38:10.762362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.763098 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.763537 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.764246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:10.764700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:10.765125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:10.854399 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d5a957df-48df-47e8-95be-659cea4bd549 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107569 Aug 24 15:38:10.855104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 510/1022] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:38:10 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:38:11.881533 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-23f63d15-9c6b-412b-a6d1-cc625c1fc378 req-0a1df18f-04ec-40ad-8eec-25e86d1c6d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c998a77-4540-4b26-84ea-1e413cff031a", "tag": "6de9ed05-6896-4761-866d-74fa12f37ba4"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:38:11.892794 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-23f63d15-9c6b-412b-a6d1-cc625c1fc378 req-0a1df18f-04ec-40ad-8eec-25e86d1c6d70 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:38:11.893570 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-23f63d15-9c6b-412b-a6d1-cc625c1fc378 req-0a1df18f-04ec-40ad-8eec-25e86d1c6d70 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:38:11.894804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-23f63d15-9c6b-412b-a6d1-cc625c1fc378 req-0a1df18f-04ec-40ad-8eec-25e86d1c6d70 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:38:11.908385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-23f63d15-9c6b-412b-a6d1-cc625c1fc378 req-0a1df18f-04ec-40ad-8eec-25e86d1c6d70 service nova] Creating event network-changed:6de9ed05-6896-4761-866d-74fa12f37ba4 for instance 3c998a77-4540-4b26-84ea-1e413cff031a on hv-cinder-84890 Aug 24 15:38:11.914661 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-23f63d15-9c6b-412b-a6d1-cc625c1fc378 req-0a1df18f-04ec-40ad-8eec-25e86d1c6d70 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037334 Aug 24 15:38:11.915913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 513/1023] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:26.997473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:26.998383 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=46 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:27.003036 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:27.003528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:27.011158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:27.011665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:27.012211 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:27.013005 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:27.013538 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:27.014000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:27.037839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0fc9926b-f2d6-4ac2-b496-d60490919418 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/ips" status: 200 len: 146 microversion: 2.1 time: 0.042063 Aug 24 15:39:27.038410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 511/1024] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:39:26 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:29.099253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:29.099992 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:29.105151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee53030b-4b80-4a95-a423-ccbfab014105"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:29.107767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:29.116333 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:29.116814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:29.117246 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:29.117942 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:29.118433 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:29.118857 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:29.353855 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-5cd57dae-5f4b-42ef-a392-3ed39b08c9f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256469 Aug 24 15:39:29.354605 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 514/1025] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:39:29 2022] POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:39:36.869339 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c850ddd6-df1d-4b61-b0ff-8178d8645d8c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:36.875906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c850ddd6-df1d-4b61-b0ff-8178d8645d8c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.876380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c850ddd6-df1d-4b61-b0ff-8178d8645d8c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.876806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c850ddd6-df1d-4b61-b0ff-8178d8645d8c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.938092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c850ddd6-df1d-4b61-b0ff-8178d8645d8c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Going to try to stop instance {{(pid=120849) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 15:39:36.980375 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c850ddd6-df1d-4b61-b0ff-8178d8645d8c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action" status: 202 len: 0 microversion: 2.1 time: 0.114631 Aug 24 15:39:36.981129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 512/1026] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:39:36 2022] POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:39:36.990245 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:36.990955 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:36.997368 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.997824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:36.998373 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:36.999093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:36.999522 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:37.000121 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:37.131711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:37.140510 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-69628b68-ab41-43e5-bc20-fb1fdbe58870 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.154995 Aug 24 15:39:37.141068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 515/1027] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:36 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:38.162683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:38.163381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:38.170042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.170546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.170983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.171703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:38.172154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:38.172588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:38.309545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:38.317663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e060e072-f79f-4206-817a-cc2f3f743751 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.160101 Aug 24 15:39:38.318248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 513/1028] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:38 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:39.339005 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:39.339603 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:39.346337 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.346824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.347252 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.347932 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:39.348378 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:39.348795 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:39.480081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:39.488161 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2a40035d-d18f-47a6-9dde-a1303b17a985 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.153062 Aug 24 15:39:39.488716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 516/1029] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:39 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:40.509166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:40.509715 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:40.515646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.516121 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.516554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.517260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:40.517706 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:40.518127 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:40.644824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:40.653084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-aae7a5ac-015f-44e8-9bcb-c69cc606ccc5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.148045 Aug 24 15:39:40.653642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 514/1030] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:40 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:41.674739 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:41.675370 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:41.681629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.682109 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.682567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.683253 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:41.683703 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:41.684121 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:41.810077 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:41.818274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4fe5314e-6bf3-4a2b-be96-ecf859a3105f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.147363 Aug 24 15:39:41.818841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 517/1031] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:41 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:42.839268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:42.839825 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:42.846203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.846713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.847149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.847838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:42.848290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:42.848715 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:42.979967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:42.988093 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5e2591b1-97e9-4309-a3e2-cebb2e9c48cd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.152714 Aug 24 15:39:42.988648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 515/1032] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:42 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:39:44.010021 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:44.010730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:44.017286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:44.017773 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:44.018207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.018938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:44.019391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:44.019815 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:44.152374 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:44.160487 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d49548cb-347c-487c-bfc7-9538a391153f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.154333 Aug 24 15:39:44.161056 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 518/1033] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:44 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:45.181962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:45.182586 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:45.188916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.189395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.189829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.190544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:45.190996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:45.191418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:45.319116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:45.328009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ddddfe9a-8bb2-44d0-b927-c0e0ef7632be tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.149900 Aug 24 15:39:45.328601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 516/1034] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:45 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:46.349180 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:46.349928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:46.357111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:46.357600 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:46.358039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.358777 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:46.359235 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:46.359662 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:46.741346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:46.750726 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-63b966b2-a4d6-442c-8ce1-3ca6bdb23280 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.405493 Aug 24 15:39:46.751300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 519/1035] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:46 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:47.772433 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:47.773041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:47.779878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.780351 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.780782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.781458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:47.781952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:47.782363 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:47.913056 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:47.921309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d62177b6-3b3d-4896-b822-c486f139567b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.152846 Aug 24 15:39:47.921877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 517/1036] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:47 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:48.942248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:48.942866 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:48.949825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:48.950328 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:48.950763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:48.951454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:48.951903 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:48.952325 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:49.082424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:49.090615 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2e86fec2-3bb7-4ea1-8c71-0b5cd189491a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.152166 Aug 24 15:39:49.091179 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 520/1037] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:48 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:50.111598 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:50.112205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:50.118851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:50.119336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:50.119771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:50.120461 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:50.120911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:50.121367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:50.247528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:50.255975 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4a299110-63b7-4a23-bcd2-57a1fc66cd6a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.148249 Aug 24 15:39:50.256541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 518/1038] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:50 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:51.279188 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:51.279767 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:51.286440 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:51.286921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:51.287352 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:51.288329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:51.288778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:51.289195 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:51.420138 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:51.428236 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4bdcd658-9a00-4c1a-b9d5-5590b0a58956 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.153610 Aug 24 15:39:51.428788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 521/1039] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:51 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:52.450143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:52.450791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:52.457252 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:52.457735 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:52.458175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:52.458895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:52.459351 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:52.459778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:52.588321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:52.596455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-339f1efb-78e5-4c2a-9d5d-244e0f3af041 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.150820 Aug 24 15:39:52.597032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 519/1040] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:52 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:53.617811 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:53.618478 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:53.625300 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.625780 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.626228 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:53.626928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:53.627381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:53.627804 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:53.756372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:53.768041 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b23308f8-0a7a-42ac-929a-7356da4adc1f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.153913 Aug 24 15:39:53.768791 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 522/1041] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:53 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:54.794708 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:54.795264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:54.801567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:54.802051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:54.802592 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:54.803289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:54.803746 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:54.804174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:54.935341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:54.943599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-eabd3f2b-6bcd-478a-9e85-2fbec135c360 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.153074 Aug 24 15:39:54.944158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 520/1042] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:54 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:55.965391 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:55.966004 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:55.972938 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:55.973426 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:55.973868 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:55.974609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:55.975072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:55.975501 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:56.109913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:56.118275 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d1ad58ad-bbcd-47e2-9ffa-a4c55bc727fe tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.157252 Aug 24 15:39:56.118841 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 523/1043] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:55 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:57.139199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:57.139820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:57.142188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=21 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:57.147382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:57.147858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:57.148296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:57.149021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:57.149471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:57.149893 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:57.152728 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:39:57.286504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:57.295994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4939f94c-2409-4b79-a932-594ad514c3d3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1723 microversion: 2.1 time: 0.160667 Aug 24 15:39:57.296568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 521/1044] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:57 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:58.316958 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:58.317611 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:58.324369 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.324861 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.325295 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.325994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.326474 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.326906 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.456436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:58.465191 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-11943416-d413-4cba-b1f1-4f319ace8d5d tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1700 microversion: 2.1 time: 0.152125 Aug 24 15:39:58.465755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 524/1045] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:58 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:58.485347 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-25c56a82-b3cd-4a04-a7f1-8c262252554a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:39:58.491792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-25c56a82-b3cd-4a04-a7f1-8c262252554a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.492264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-25c56a82-b3cd-4a04-a7f1-8c262252554a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.492695 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-25c56a82-b3cd-4a04-a7f1-8c262252554a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.515248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-25c56a82-b3cd-4a04-a7f1-8c262252554a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Going to try to start instance {{(pid=120849) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 15:39:58.556998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-25c56a82-b3cd-4a04-a7f1-8c262252554a tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action" status: 202 len: 0 microversion: 2.1 time: 0.075392 Aug 24 15:39:58.557632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 522/1046] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:39:58 2022] POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:39:58.565762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:58.566411 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:58.573107 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.573642 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.574080 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.574824 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:58.575282 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:58.575707 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:58.744222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:58.752972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-581ecc3e-13fc-4c9c-9f8a-9101bbf792f1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1709 microversion: 2.1 time: 0.190980 Aug 24 15:39:58.753552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 525/1047] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:58 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:39:59.775219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:39:59.775935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:39:59.782321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:59.782878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:59.783320 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:59.784024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:39:59.784478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:39:59.784906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:39:59.918245 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:39:59.926446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9f65ccd1-8ee4-4b88-8cbd-7c199ccf39a3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1713 microversion: 2.1 time: 0.156072 Aug 24 15:39:59.927012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 523/1048] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:39:59 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:02.626658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:40:02.627599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:40:55.293285 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:55.293915 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:55.296280 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=24 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:55.297067 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:55.302629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:55.303114 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:55.303552 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:55.304250 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:55.304708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:55.305159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:55.389803 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lazy-loading 'services' on Instance uuid 3c998a77-4540-4b26-84ea-1e413cff031a {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:40:55.461506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b5e2b319-3515-48ff-bd52-abd229103c7f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-volume_attachments/ee53030b-4b80-4a95-a423-ccbfab014105" status: 202 len: 0 microversion: 2.1 time: 0.172077 Aug 24 15:40:55.462292 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 526/1049] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:40:55 2022] DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-volume_attachments/ee53030b-4b80-4a95-a423-ccbfab014105 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:56.582771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fd0686f3-d5e2-454c-9d61-93081eb692ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:40:56.585167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=5 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:56.585967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:40:56.592400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd0686f3-d5e2-454c-9d61-93081eb692ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:56.592888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd0686f3-d5e2-454c-9d61-93081eb692ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:56.593319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd0686f3-d5e2-454c-9d61-93081eb692ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:56.616487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fd0686f3-d5e2-454c-9d61-93081eb692ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Going to try to stop instance {{(pid=120849) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 15:40:56.657143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fd0686f3-d5e2-454c-9d61-93081eb692ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action" status: 202 len: 0 microversion: 2.1 time: 0.078133 Aug 24 15:40:56.657885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 524/1050] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:40:56 2022] POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:40:56.667971 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:56.668676 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:56.675070 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:56.675567 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:56.676002 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:56.676825 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:56.677344 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:56.677776 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:56.813893 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:56.821709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a789cff0-60ea-4f31-8a58-42cb17efa2ad tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.159374 Aug 24 15:40:56.822289 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 527/1051] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:56 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:40:57.844050 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:57.844654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:57.851531 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.852000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.852425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.853238 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:57.853688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:57.854100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:57.984042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:57.991723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7e2cd657-333e-4747-92f1-98b929843694 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.151996 Aug 24 15:40:57.992279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 525/1052] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:57 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:40:59.012999 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:40:59.013604 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:40:59.020480 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:59.021139 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:59.021574 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:59.022372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:40:59.022822 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:40:59.023240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:40:59.158372 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:40:59.166578 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e2bbd9f0-ba1a-438b-bdb7-011c2e09cf0b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.157399 Aug 24 15:40:59.167153 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 528/1053] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:40:59 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:00.188082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:00.188689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:00.195018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:00.195493 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:00.195923 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:00.196605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:00.197050 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:00.197470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:00.343823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:00.352167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7d675527-5cf9-4efc-a077-e2428d89633c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.167475 Aug 24 15:41:00.353305 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 526/1054] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:00 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:01.373927 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:01.374560 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:01.380866 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:01.381341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:01.381769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:01.382483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:01.382931 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:01.383347 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:01.514553 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:01.522257 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-c63acc98-d205-40b5-ae49-ce00ec497dd0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.152168 Aug 24 15:41:01.522808 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 529/1055] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:01 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:02.544028 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:02.544567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:02.551187 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:02.551689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:02.552107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:02.552797 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:02.553248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:02.553672 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:02.681748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:02.689621 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bb9852a8-e981-4ec0-8700-c4f5714b2d15 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.149492 Aug 24 15:41:02.690183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 527/1056] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:02 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:03.711316 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:03.712497 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:03.718867 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:03.719346 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:03.719781 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:03.720472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:03.720926 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:03.721349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:03.859654 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:03.869285 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1897aae5-57bf-45ff-93bd-a915bf6940f8 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.161839 Aug 24 15:41:03.869854 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 530/1057] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:03 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:04.892064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:04.892667 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:04.898999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:04.899477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:04.899907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:04.900580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:04.901025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:04.901441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:05.033080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:05.041352 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fe6d3a4c-c89d-424d-ab69-f8dece25c18c tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.153213 Aug 24 15:41:05.042062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 528/1058] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:04 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:06.062843 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:06.063450 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:06.069609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:06.070093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:06.070573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.071752 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:06.072206 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:06.072630 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:06.203694 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:06.211390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-b71f3635-c4da-48c2-bab5-727e10508475 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1677 microversion: 2.1 time: 0.152485 Aug 24 15:41:06.212024 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 531/1059] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:06 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:07.233143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:07.233675 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:07.240323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.240802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.241241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.241931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.242412 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.242837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.373445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:07.381057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e16b1e05-66b5-45ce-986a-1c8f4ea02f51 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1654 microversion: 2.1 time: 0.151945 Aug 24 15:41:07.381619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 529/1060] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:07 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:07.402573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-6885743a-707a-49a0-ab3e-427388bc856b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:41:07.409068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6885743a-707a-49a0-ab3e-427388bc856b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.409550 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6885743a-707a-49a0-ab3e-427388bc856b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.409984 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-6885743a-707a-49a0-ab3e-427388bc856b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.472941 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-6885743a-707a-49a0-ab3e-427388bc856b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Going to try to start instance {{(pid=120848) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 15:41:07.515489 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-6885743a-707a-49a0-ab3e-427388bc856b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action" status: 202 len: 0 microversion: 2.1 time: 0.117215 Aug 24 15:41:07.516011 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 532/1061] 10.222.0.76 () {60 vars in 1278 bytes} [Wed Aug 24 15:41:07 2022] POST /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:41:07.525226 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:07.525833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:07.532888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.533703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.533800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.534527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:07.534983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:07.535407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:07.681021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:07.689597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b56b2d8a-7bc2-4543-a3e0-56c5427f0d6e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1663 microversion: 2.1 time: 0.168829 Aug 24 15:41:07.690177 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 530/1062] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:07 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:41:08.713778 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:08.714908 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:08.720586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.721066 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.721500 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.722189 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:08.722672 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:08.723103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:08.853798 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:08.861400 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-54d5b14f-89de-4c42-8935-43e430463858 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1663 microversion: 2.1 time: 0.152755 Aug 24 15:41:08.861959 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 533/1063] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:08 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:41:09.881434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:41:09.882015 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:41:09.888584 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:09.889062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:09.889494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:09.890174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:41:09.890646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:41:09.891068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:41:10.022826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:41:10.030499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a6e0caaf-fffe-4f01-aebd-7e04e29b91bd tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1667 microversion: 2.1 time: 0.153074 Aug 24 15:41:10.031055 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 531/1064] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:41:09 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:42:13.312267 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=16 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:13.313017 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:13.316976 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:13.319309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:13.327094 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.327580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.328019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.328726 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.329185 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.329613 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.359575 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-0e1ba317-91c3-497e-8acb-a6fddc496ff4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049167 Aug 24 15:42:13.360133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 534/1065] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:42:13 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:42:13.423025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:13.423557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:13.425624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=16 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:13.426301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:13.432713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.433197 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.433633 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.434353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.434808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.435234 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.460124 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:42:13.536624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9cf70742-476b-4ce7-8441-a527c2bc400e tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 204 len: 0 microversion: 2.1 time: 0.117865 Aug 24 15:42:13.537274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 532/1066] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:42:13 2022] DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:42:13.546084 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:13.546719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:13.553310 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.553788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.554879 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.555573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:13.556019 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:13.556438 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:13.847760 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:13.857014 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-73cee545-5a24-4f81-aa1a-3a631ad2b9b3 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1673 microversion: 2.1 time: 0.314731 Aug 24 15:42:13.857580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 535/1067] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:13 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1673 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:14.878737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:14.879380 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:14.886416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.886901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.887334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:14.888031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:14.888486 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:14.888901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:15.070801 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:15.078430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5d524850-974c-43ff-a2ef-d27ea9b70122 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1673 microversion: 2.1 time: 0.204026 Aug 24 15:42:15.078992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 533/1068] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:14 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:16.101222 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:16.101795 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:16.108158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.108645 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.109080 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:16.109774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.110248 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.110678 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:16.313174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:16.321559 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-e9a98c58-ae1c-4434-afa3-25fc5e7ae2ac tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 200 len: 1673 microversion: 2.1 time: 0.224463 Aug 24 15:42:16.322133 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 536/1069] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:16 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:16.768743 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-1f240d31-e118-4fcd-9853-bdb07776870c req-78878e32-0004-4ed4-9cec-33e9b871862e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c998a77-4540-4b26-84ea-1e413cff031a", "name": "network-vif-deleted", "tag": "6de9ed05-6896-4761-866d-74fa12f37ba4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:16.779556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1f240d31-e118-4fcd-9853-bdb07776870c req-78878e32-0004-4ed4-9cec-33e9b871862e service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:16.780029 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1f240d31-e118-4fcd-9853-bdb07776870c req-78878e32-0004-4ed4-9cec-33e9b871862e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:16.780456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1f240d31-e118-4fcd-9853-bdb07776870c req-78878e32-0004-4ed4-9cec-33e9b871862e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:16.792285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-1f240d31-e118-4fcd-9853-bdb07776870c req-78878e32-0004-4ed4-9cec-33e9b871862e service nova] Creating event network-vif-deleted:6de9ed05-6896-4761-866d-74fa12f37ba4 for instance 3c998a77-4540-4b26-84ea-1e413cff031a on hv-cinder-84890 Aug 24 15:42:16.798207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-1f240d31-e118-4fcd-9853-bdb07776870c req-78878e32-0004-4ed4-9cec-33e9b871862e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100515 Aug 24 15:42:16.803117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 534/1070] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:17.343205 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:17.343810 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:17.350381 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:17.352132 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:17.352736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:17.353314 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:17.353774 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:17.354324 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:17.368635 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] HTTP exception thrown: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Request method failure captured: Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a HTTP/1.1 Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkXVI6mSasYukiot4nt0_jz9eRHs9jZlb9TkFj1FIkYDa-Z6BDbhwHWmGHBi3F4vnz_RMW_7emRMLEC5HKbMgOY_lsZQ4aSuR-PavA6Bqr5gaX8oZToUjj3rg0nRTApLfiZJoojEDcw0a1uV_d6CXifUA9mP-Pf3ZGhMpLdJWMdF4SM Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:42:17.370354 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2839782e51514ea698132e8a290b9a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2839782e51514ea698132e8a290b9a20", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}] Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 93b9cabb6bcb4141937ea814e0123bf0 Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:42:17.371918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '3c998a77-4540-4b26-84ea-1e413cff031a'} Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:42:17.372769 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:42:17.374102 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:42:17.375454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Returning 404 to user: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:42:17.375454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d204906b-dd0d-4908-9126-96357505a1eb tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 404 len: 111 microversion: 2.1 time: 0.032429 Aug 24 15:42:17.375454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 537/1071] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:17 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:42:17.381565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5575e544-840f-4764-bebc-83a9d292b2b1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '.version_select at 0x7f66592961f0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:17.405937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5575e544-840f-4764-bebc-83a9d292b2b1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734531587" status: 202 len: 0 microversion: 2.1 time: 0.028422 Aug 24 15:42:17.406836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 535/1072] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 15:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734531587 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:42:18.058709 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-cd82f848-8a9c-4e63-8704-aa89297441f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: .version_select at 0x7f6659372ee0>, body: {"keypair": {"name": "tempest-keypair-248105318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBWf6iNXxNXN2GSMTv7oJ93X5mHogvFm3pkQpb/ffuUGiQMlmuHWUYofHa8Y0eRGc6amKMpKB8X9Ggugg19cxhVR7cBH5M1ECPOrWBvq9PgmIlwZ/mM62eJ8X7J3T7t3Q=="}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:18.074194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-cd82f848-8a9c-4e63-8704-aa89297441f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for project 2839782e51514ea698132e8a290b9a20. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:18.078028 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-cd82f848-8a9c-4e63-8704-aa89297441f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for user 93b9cabb6bcb4141937ea814e0123bf0 and project 2839782e51514ea698132e8a290b9a20. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:18.090105 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd82f848-8a9c-4e63-8704-aa89297441f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [81eb5b5b-71c4-4fdc-852a-cf6709e51b19] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 15:42:19.097647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd82f848-8a9c-4e63-8704-aa89297441f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [81eb5b5b-71c4-4fdc-852a-cf6709e51b19] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33616. Aug 24 15:42:19.111538 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-cd82f848-8a9c-4e63-8704-aa89297441f2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.057621 Aug 24 15:42:19.112128 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 538/1073] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:42:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:20.361940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-590833724", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d48f6cca-7726-4b32-a688-f7802fcd6c63"}], "security_groups": [{"name": "tempest-securitygroup--1345485751"}], "key_name": "tempest-keypair-248105318", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:20.463094 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] validate_networks() for [('d48f6cca-7726-4b32-a688-f7802fcd6c63', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:42:20.875062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:42:20.875488 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:42:20.875967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:42:20.876379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:42:20.876796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:42:20.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:20.886018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:20.886490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:20.887224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:20.887677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:20.888107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:20.904929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for project 2839782e51514ea698132e8a290b9a20. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:42:20.908854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Getting quotas for user 93b9cabb6bcb4141937ea814e0123bf0 and project 2839782e51514ea698132e8a290b9a20. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:42:20.920585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:42:20.922966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:42:20.967829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [104df381-731e-4198-8bcb-86f87d5bffbb] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 15:42:21.974197 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [104df381-731e-4198-8bcb-86f87d5bffbb] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 33644. Aug 24 15:42:21.979255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c3eaead6-2627-482f-b086-7879b68fffc0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.622056 Aug 24 15:42:21.979901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 536/1074] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:42:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:42:21.992029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-658feafe-0881-47e8-98e5-14ae5f09c2ff tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:21.992763 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-658feafe-0881-47e8-98e5-14ae5f09c2ff tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:22.050454 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-658feafe-0881-47e8-98e5-14ae5f09c2ff tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:22.057501 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-658feafe-0881-47e8-98e5-14ae5f09c2ff tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1236 microversion: 2.1 time: 0.070499 Aug 24 15:42:22.058068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 539/1075] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:21 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:23.078023 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:23.078662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:23.086258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.086623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.087062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.087763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:23.088221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:23.088648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:23.153627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:23.161669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a0a5ad34-579e-4ff2-8b0a-4a570d9c12ba tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1294 microversion: 2.1 time: 0.087950 Aug 24 15:42:23.162248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 537/1076] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:23 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:24.183869 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:24.184443 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:24.191924 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.192412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.192872 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:24.193580 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.194034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.194530 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:24.429581 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:24.437151 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-adbd4257-1bbd-4860-bf3f-562b1b872cab tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1362 microversion: 2.1 time: 0.257401 Aug 24 15:42:24.437711 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 540/1077] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:24 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:24.557453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-77e87126-a5f6-4d35-b258-60e1ff8bc6ad req-f9a47d1a-ed52-4203-8eb2-60ba9f0c91bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54105384-c289-4fd8-b5a5-590b00f87783", "tag": "6004c666-dd09-4fab-b943-18bf3f29e579"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:24.570281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-77e87126-a5f6-4d35-b258-60e1ff8bc6ad req-f9a47d1a-ed52-4203-8eb2-60ba9f0c91bc service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:24.570803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-77e87126-a5f6-4d35-b258-60e1ff8bc6ad req-f9a47d1a-ed52-4203-8eb2-60ba9f0c91bc service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:24.571419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-77e87126-a5f6-4d35-b258-60e1ff8bc6ad req-f9a47d1a-ed52-4203-8eb2-60ba9f0c91bc service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:24.583899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-77e87126-a5f6-4d35-b258-60e1ff8bc6ad req-f9a47d1a-ed52-4203-8eb2-60ba9f0c91bc service nova] Creating event network-changed:6004c666-dd09-4fab-b943-18bf3f29e579 for instance 54105384-c289-4fd8-b5a5-590b00f87783 on hv-cinder-84890 Aug 24 15:42:24.588819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-77e87126-a5f6-4d35-b258-60e1ff8bc6ad req-f9a47d1a-ed52-4203-8eb2-60ba9f0c91bc service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035728 Aug 24 15:42:24.589408 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 538/1078] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:25.457338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:25.457954 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:25.465027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:25.465506 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:25.465940 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:25.466659 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:25.467115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:25.467539 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:25.601787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:25.609388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f485e322-efd0-4228-9461-eb07ec3cc79f tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1362 microversion: 2.1 time: 0.156273 Aug 24 15:42:25.609941 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 541/1079] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:25 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:26.630876 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:26.631589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:26.638819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:26.639309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:26.639736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:26.640418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:26.640863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:26.641280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:26.771166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:26.779034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-978a6738-95a6-4f2a-8516-aca662723de1 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1362 microversion: 2.1 time: 0.152435 Aug 24 15:42:26.779646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 539/1080] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:26 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:27.799874 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:27.800451 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:27.807566 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.808051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.808480 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.809161 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:27.809609 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:27.810025 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:27.945234 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:27.952890 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-14c4055d-daf2-4af6-8753-fa2d415da918 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1362 microversion: 2.1 time: 0.156974 Aug 24 15:42:27.953438 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 542/1081] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:27 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:28.973379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:28.973994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:28.981069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.981551 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.981990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:28.982713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:28.983196 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:28.983626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.117414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:29.125207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e691a1b6-ccc9-4b34-8e57-7a1a75f62654 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1362 microversion: 2.1 time: 0.155739 Aug 24 15:42:29.126009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 540/1082] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:28 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:29.250573 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-a1706355-95b0-4f51-a05a-4e5180fb1803 req-66af5d4d-2588-462d-933e-7c60d3a8133e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54105384-c289-4fd8-b5a5-590b00f87783", "name": "network-vif-plugged", "status": "completed", "tag": "6004c666-dd09-4fab-b943-18bf3f29e579"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:29.261581 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-a1706355-95b0-4f51-a05a-4e5180fb1803 req-66af5d4d-2588-462d-933e-7c60d3a8133e service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:29.262692 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-a1706355-95b0-4f51-a05a-4e5180fb1803 req-66af5d4d-2588-462d-933e-7c60d3a8133e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:29.263155 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-a1706355-95b0-4f51-a05a-4e5180fb1803 req-66af5d4d-2588-462d-933e-7c60d3a8133e service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:29.275098 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-a1706355-95b0-4f51-a05a-4e5180fb1803 req-66af5d4d-2588-462d-933e-7c60d3a8133e service nova] Creating event network-vif-plugged:6004c666-dd09-4fab-b943-18bf3f29e579 for instance 54105384-c289-4fd8-b5a5-590b00f87783 on hv-cinder-84890 Aug 24 15:42:29.280243 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-a1706355-95b0-4f51-a05a-4e5180fb1803 req-66af5d4d-2588-462d-933e-7c60d3a8133e service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033438 Aug 24 15:42:29.281027 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 543/1083] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:30.145505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:30.146116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:30.152507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.153015 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.153450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.154137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:30.154612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:30.155035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:30.286470 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:30.294850 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b8549d48-0a7e-479d-aeac-53af8a554676 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1362 microversion: 2.1 time: 0.153228 Aug 24 15:42:30.295422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 541/1084] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:30 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:31.319524 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:31.320821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:31.330586 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.331081 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.331527 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.332233 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.332695 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.333126 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.471746 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:42:31.479596 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f4182a11-d803-4657-86ae-9f8c617e5f4b tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1549 microversion: 2.1 time: 0.168008 Aug 24 15:42:31.480159 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 544/1085] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:42:31 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:42:31.500535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:42:31.501098 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:42:31.502981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:31.503632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=6 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:31.510580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.511061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.511498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.512187 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:31.512637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:31.513061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:31.593358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-404e0b34-24d8-4936-adce-fa5ab0affb57 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096640 Aug 24 15:42:31.593939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 542/1086] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:42:31 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:42:32.730353 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-87772ee1-81ed-4edb-9767-85e6af7fafdc req-72cd6374-193b-4b6d-b1b4-bb2069ae1d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54105384-c289-4fd8-b5a5-590b00f87783", "tag": "6004c666-dd09-4fab-b943-18bf3f29e579"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:42:32.735154 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:42:32.741994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-87772ee1-81ed-4edb-9767-85e6af7fafdc req-72cd6374-193b-4b6d-b1b4-bb2069ae1d1f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:42:32.742498 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-87772ee1-81ed-4edb-9767-85e6af7fafdc req-72cd6374-193b-4b6d-b1b4-bb2069ae1d1f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:42:32.742921 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-87772ee1-81ed-4edb-9767-85e6af7fafdc req-72cd6374-193b-4b6d-b1b4-bb2069ae1d1f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:42:32.754055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-87772ee1-81ed-4edb-9767-85e6af7fafdc req-72cd6374-193b-4b6d-b1b4-bb2069ae1d1f service nova] Creating event network-changed:6004c666-dd09-4fab-b943-18bf3f29e579 for instance 54105384-c289-4fd8-b5a5-590b00f87783 on hv-cinder-84890 Aug 24 15:42:32.759232 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-87772ee1-81ed-4edb-9767-85e6af7fafdc req-72cd6374-193b-4b6d-b1b4-bb2069ae1d1f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032488 Aug 24 15:42:32.760039 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 545/1087] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:37.482328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.483185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:37.540411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:37.541157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:37.547057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:37.547532 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:37.547963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:37.548647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:37.549092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:37.549510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:37.572371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-27b6b338-1cca-49e7-bd8d-513672bc1492 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/ips" status: 200 len: 146 microversion: 2.1 time: 0.091787 Aug 24 15:43:37.572916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 543/1088] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:43:37 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/ips => generated 146 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:38.896329 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:38.897115 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=48 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:43:38.902599 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8250a131-d0f6-445e-8265-1f630c131e7e"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:38.904979 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:38.912409 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:38.912912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:38.913340 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:38.914624 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:38.915072 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:38.915491 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:39.147047 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2d5d2f4e-91ba-418e-ac2c-36be0ca42609 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252488 Aug 24 15:43:39.148308 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 546/1089] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:43:38 2022] POST /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:46.666921 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:46.669187 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:46.675169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:46.675656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:46.676095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:46.676786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:46.677244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:46.677676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:46.706716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c9fda2d5-86ca-4fd5-bbd4-f1d38a6daa26 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Aug 24 15:43:46.707261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 544/1090] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:46 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:46.719472 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:46.720112 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:46.726716 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:46.727184 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:46.727629 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:46.728395 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:46.728788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:46.729215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:46.757278 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a51a105d-b307-4d9b-8020-42835f8f77a0 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/8250a131-d0f6-445e-8265-1f630c131e7e" status: 200 len: 194 microversion: 2.1 time: 0.042613 Aug 24 15:43:46.757852 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 547/1091] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 24 15:43:46 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/8250a131-d0f6-445e-8265-1f630c131e7e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:48.096958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc6d441b-addc-4f88-8282-098400fed71e"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:43:48.099291 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:48.106481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:48.106958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:48.107396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:48.108080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:48.108530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:48.108952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:48.353447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5a94ccf0-17bd-4f5f-b928-cfb8f59e2027 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "POST /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260216 Aug 24 15:43:48.354045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 545/1092] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:43:48 2022] POST /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:55.875455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:55.877968 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:55.884476 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:55.884994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:55.885436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.886175 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:55.887073 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:55.887519 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:55.918424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a83cb355-44ba-453e-a52d-6a0625f3c4c4 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047211 Aug 24 15:43:55.918987 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 548/1093] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:55 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:56.061471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:56.062024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:56.068239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.068712 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.069142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.069827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.070298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.070721 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.098932 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3bb0f09e-eb84-43b5-8169-d196ea07d8d7 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/8250a131-d0f6-445e-8265-1f630c131e7e" status: 200 len: 194 microversion: 2.1 time: 0.042382 Aug 24 15:43:56.099393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 546/1094] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 24 15:43:56 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/8250a131-d0f6-445e-8265-1f630c131e7e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:56.110199 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:56.110745 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:56.116885 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.117424 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.117892 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.118612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:56.119068 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:56.119543 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:56.201821 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lazy-loading 'services' on Instance uuid 54105384-c289-4fd8-b5a5-590b00f87783 {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:43:56.275375 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f0a93381-87c4-408a-b0d8-fe31b2455f75 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/8250a131-d0f6-445e-8265-1f630c131e7e" status: 202 len: 0 microversion: 2.1 time: 0.168765 Aug 24 15:43:56.276715 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 549/1095] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:43:56 2022] DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/8250a131-d0f6-445e-8265-1f630c131e7e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:43:57.396009 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:57.396596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:57.402911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.403393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.403836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.404529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.404981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.405409 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.434934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8a4987df-eaf3-4a26-8617-546a9e398313 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/bc6d441b-addc-4f88-8282-098400fed71e" status: 200 len: 194 microversion: 2.1 time: 0.042979 Aug 24 15:43:57.435521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 547/1096] 10.222.0.76 () {58 vars in 1413 bytes} [Wed Aug 24 15:43:57 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/bc6d441b-addc-4f88-8282-098400fed71e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:43:57.446805 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:57.447385 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:57.453542 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.454022 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.454483 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.455217 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:57.455669 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:57.456090 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:57.534814 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.objects.instance [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lazy-loading 'services' on Instance uuid 54105384-c289-4fd8-b5a5-590b00f87783 {{(pid=120848) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:43:57.605445 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-d73d03c9-3533-4b13-9e01-02291dad2247 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/bc6d441b-addc-4f88-8282-098400fed71e" status: 202 len: 0 microversion: 2.1 time: 0.163265 Aug 24 15:43:57.605949 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 550/1097] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:43:57 2022] DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments/bc6d441b-addc-4f88-8282-098400fed71e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:43:58.781276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:58.783534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:58.790275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:58.791013 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:58.791938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:58.792625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:58.793069 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:58.793487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:58.823181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e3796e65-0198-45fb-8c7d-60971ae887df tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045836 Aug 24 15:43:58.823748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 548/1098] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:58 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:43:58.940647 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:58.942918 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:58.949197 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:58.949682 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:58.950121 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:58.950925 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:58.951390 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:58.951835 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:58.989721 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-1d00582f-8eb5-44d0-bf77-9fd2a9e2ff84 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053881 Aug 24 15:43:58.990309 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 551/1099] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:43:58 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 15:43:59.059245 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:59.059742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:59.065891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.066434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.066871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.067566 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.068021 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.068449 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.095132 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:43:59.182733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7f64e1c3-2d82-4d16-80ca-acf32ebb8a39 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 204 len: 0 microversion: 2.1 time: 0.129627 Aug 24 15:43:59.183328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 549/1100] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:43:59 2022] DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:43:59.191436 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:43:59.191968 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:43:59.197875 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.198393 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.198829 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.199517 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:43:59.199966 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:43:59.200386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:43:59.345103 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:43:59.353074 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-aef2e5f6-ed59-4c8c-9b6c-7c313faebce2 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1673 microversion: 2.1 time: 0.165504 Aug 24 15:43:59.353638 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 552/1101] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:43:59 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:00.375567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:00.376286 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:00.382808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:00.383292 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:00.383730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:00.384426 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:00.384908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:00.385337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:00.524406 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:00.532649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b01db6be-b216-4621-8c5a-16f3bc5b96cf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1673 microversion: 2.1 time: 0.161341 Aug 24 15:44:00.533219 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 550/1102] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:00 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:01.555168 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:01.555790 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:01.563380 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:01.563786 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:01.564221 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:01.564928 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:01.565473 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:01.565805 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:01.822034 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93b9cabb6bcb4141937ea814e0123bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2839782e51514ea698132e8a290b9a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:01.830274 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-9a07e14d-ca98-401b-801a-d90d55b64342 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 200 len: 1673 microversion: 2.1 time: 0.278863 Aug 24 15:44:01.830834 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 553/1103] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:01 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 1673 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:02.247676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-810579aa-fe91-4db7-a97e-05eed2c9d207 req-8080c030-fbb7-4a06-8f7c-4dbc59dd8ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54105384-c289-4fd8-b5a5-590b00f87783", "name": "network-vif-deleted", "tag": "6004c666-dd09-4fab-b943-18bf3f29e579"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:02.258169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-810579aa-fe91-4db7-a97e-05eed2c9d207 req-8080c030-fbb7-4a06-8f7c-4dbc59dd8ff9 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:02.258673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-810579aa-fe91-4db7-a97e-05eed2c9d207 req-8080c030-fbb7-4a06-8f7c-4dbc59dd8ff9 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:02.259108 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-810579aa-fe91-4db7-a97e-05eed2c9d207 req-8080c030-fbb7-4a06-8f7c-4dbc59dd8ff9 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:02.270888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-810579aa-fe91-4db7-a97e-05eed2c9d207 req-8080c030-fbb7-4a06-8f7c-4dbc59dd8ff9 service nova] Creating event network-vif-deleted:6004c666-dd09-4fab-b943-18bf3f29e579 for instance 54105384-c289-4fd8-b5a5-590b00f87783 on hv-cinder-84890 Aug 24 15:44:02.276931 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-810579aa-fe91-4db7-a97e-05eed2c9d207 req-8080c030-fbb7-4a06-8f7c-4dbc59dd8ff9 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032687 Aug 24 15:44:02.278139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 551/1104] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:02.853456 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:02.854687 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:02.861790 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:02.862788 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:02.863230 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:02.863939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:02.864401 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:02.864830 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:02.880449 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] HTTP exception thrown: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Request method failure captured: Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 HTTP/1.1 Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkXVI6mSasYukiot4nt0_jz9eRHs9jZlb9TkFj1FIkYDa-Z6BDbhwHWmGHBi3F4vnz_RMW_7emRMLEC5HKbMgOY_lsZQ4aSuR-PavA6Bqr5gaX8oZToUjj3rg0nRTApLfiZJoojEDcw0a1uV_d6CXifUA9mP-Pf3ZGhMpLdJWMdF4SM Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:44:02.882912 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2839782e51514ea698132e8a290b9a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2839782e51514ea698132e8a290b9a20", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}] Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 93b9cabb6bcb4141937ea814e0123bf0 Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:02.885534 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '54105384-c289-4fd8-b5a5-590b00f87783'} Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:02.886643 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:02.888204 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:02.890388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Returning 404 to user: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:02.890388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-4caee9d2-4116-4b1a-8b4d-d35a78d530bf tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 404 len: 111 microversion: 2.1 time: 0.035684 Aug 24 15:44:02.890388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 554/1105] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:02 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:02.895511 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-41c579f8-311e-4c5c-8b48-d108bfd97358 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '.version_select at 0x7f6659bb09d0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:02.915627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-41c579f8-311e-4c5c-8b48-d108bfd97358 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248105318" status: 202 len: 0 microversion: 2.1 time: 0.025149 Aug 24 15:44:02.917216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 552/1106] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 15:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248105318 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:44:05.883708 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:05.884216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:05.890880 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:05.891355 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:05.891787 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:05.892466 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:05.892913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:05.893335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:05.906951 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] HTTP exception thrown: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Request method failure captured: Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 HTTP/1.1 Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkXVI6mSasYukiot4nt0_jz9eRHs9jZlb9TkFj1FIkYDa-Z6BDbhwHWmGHBi3F4vnz_RMW_7emRMLEC5HKbMgOY_lsZQ4aSuR-PavA6Bqr5gaX8oZToUjj3rg0nRTApLfiZJoojEDcw0a1uV_d6CXifUA9mP-Pf3ZGhMpLdJWMdF4SM Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:44:05.908465 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2839782e51514ea698132e8a290b9a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2839782e51514ea698132e8a290b9a20", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}] Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 93b9cabb6bcb4141937ea814e0123bf0 Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.910134 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '54105384-c289-4fd8-b5a5-590b00f87783'} Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:05.911193 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.912736 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.914297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Returning 404 to user: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:05.914297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-be6104cb-866c-4e56-81da-bacc4e76acdc tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 404 len: 111 microversion: 2.1 time: 0.030115 Aug 24 15:44:05.914297 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 555/1107] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:44:05 2022] DELETE /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:05.920130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:05.920862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 54105384-c289-4fd8-b5a5-590b00f87783] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:05.927778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:05.928192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:05.928628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:05.929304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:05.929750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:05.930172 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:05.943862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] HTTP exception thrown: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Request method failure captured: Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 HTTP/1.1 Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkXVI6mSasYukiot4nt0_jz9eRHs9jZlb9TkFj1FIkYDa-Z6BDbhwHWmGHBi3F4vnz_RMW_7emRMLEC5HKbMgOY_lsZQ4aSuR-PavA6Bqr5gaX8oZToUjj3rg0nRTApLfiZJoojEDcw0a1uV_d6CXifUA9mP-Pf3ZGhMpLdJWMdF4SM Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:44:05.945489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2839782e51514ea698132e8a290b9a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2839782e51514ea698132e8a290b9a20", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}] Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 93b9cabb6bcb4141937ea814e0123bf0 Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.947258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '54105384-c289-4fd8-b5a5-590b00f87783'} Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:05.948149 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. Aug 24 15:44:05.949510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:05.950936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Returning 404 to user: Instance 54105384-c289-4fd8-b5a5-590b00f87783 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:05.950936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cf48df82-ca80-46c0-a109-e617565d7a00 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783" status: 404 len: 111 microversion: 2.1 time: 0.032497 Aug 24 15:44:05.950936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 553/1108] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:05 2022] GET /compute/v2.1/servers/54105384-c289-4fd8-b5a5-590b00f87783 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:07.084939 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:07.085441 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:07.091730 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.092207 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.092641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.093321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.093771 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.094194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.109096 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.wsgi [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] HTTP exception thrown: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Request method failure captured: Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: request: DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a HTTP/1.1 Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept: application/json Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Accept-Encoding: identity Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Connection: close Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Length: 0 Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Content-Type: application/json Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Host: 10.222.0.76 Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Openstack-System-Scope: None Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Auth-Token: gAAAAABjBkXVI6mSasYukiot4nt0_jz9eRHs9jZlb9TkFj1FIkYDa-Z6BDbhwHWmGHBi3F4vnz_RMW_7emRMLEC5HKbMgOY_lsZQ4aSuR-PavA6Bqr5gaX8oZToUjj3rg0nRTApLfiZJoojEDcw0a1uV_d6CXifUA9mP-Pf3ZGhMpLdJWMdF4SM Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Id: None Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Domain-Name: None Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Identity-Status: Confirmed Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Is-Admin-Project: True Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Id: default Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Domain-Name: Default Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Project-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Role: reader,member Aug 24 15:44:07.110652 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Roles: reader,member Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2839782e51514ea698132e8a290b9a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2839782e51514ea698132e8a290b9a20", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}] Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Id: default Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Domain-Name: Default Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Id: 93b9cabb6bcb4141937ea814e0123bf0 Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: X-User-Name: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: method: > Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: exception: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.112413 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: action_args: {'id': '3c998a77-4540-4b26-84ea-1e413cff031a'} Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:07.113279 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.114612 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.115907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Returning 404 to user: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. {{(pid=120848) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:07.115907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-a0b0895b-c80a-4545-ae8f-a1d1b1e14b53 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 404 len: 111 microversion: 2.1 time: 0.030895 Aug 24 15:44:07.115907 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 556/1109] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:44:07 2022] DELETE /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:07.121300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:07.121916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] [instance: 3c998a77-4540-4b26-84ea-1e413cff031a] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:07.128400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.128881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.129314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.130005 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:07.130484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:07.130919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:07.144032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] HTTP exception thrown: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Request method failure captured: Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a HTTP/1.1 Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkXVI6mSasYukiot4nt0_jz9eRHs9jZlb9TkFj1FIkYDa-Z6BDbhwHWmGHBi3F4vnz_RMW_7emRMLEC5HKbMgOY_lsZQ4aSuR-PavA6Bqr5gaX8oZToUjj3rg0nRTApLfiZJoojEDcw0a1uV_d6CXifUA9mP-Pf3ZGhMpLdJWMdF4SM Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:44:07.145588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/2839782e51514ea698132e8a290b9a20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_2839782e51514ea698132e8a290b9a20", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/2839782e51514ea698132e8a290b9a20"}]}] Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: 2839782e51514ea698132e8a290b9a20 Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1425134538 Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 93b9cabb6bcb4141937ea814e0123bf0 Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeTestJSON-1425134538-project Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.147720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '3c998a77-4540-4b26-84ea-1e413cff031a'} Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:44:07.148727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. Aug 24 15:44:07.150314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:44:07.151903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] Returning 404 to user: Instance 3c998a77-4540-4b26-84ea-1e413cff031a could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:44:07.151903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fc69efd1-7254-4e41-a22e-8ec645f416d5 tempest-AttachVolumeTestJSON-1425134538 tempest-AttachVolumeTestJSON-1425134538-project] 10.222.0.76 "GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a" status: 404 len: 111 microversion: 2.1 time: 0.030392 Aug 24 15:44:07.151903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 554/1110] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:07 2022] GET /compute/v2.1/servers/3c998a77-4540-4b26-84ea-1e413cff031a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:44:15.982858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-924fd6f7-9cb0-484f-90fe-7a464775c991 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: .version_select at 0x7f66591b4c10>, body: {"keypair": {"name": "tempest-keypair-1795333925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDf+CzHIkjMHBmWGuyd5BlvUZlj+Sjx24kISyXT8cMvsYxVMJZryEP9yYL4HUMxkpBAbgtuRp0lvGMQBiqsGVxEMYXr1aAplRoTX0wEApDBm01YCC0ppBX12+t9Ep2Vuw=="}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:15.990065 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=23 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:16.009847 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-924fd6f7-9cb0-484f-90fe-7a464775c991 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:44:16.013967 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-924fd6f7-9cb0-484f-90fe-7a464775c991 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:44:16.045349 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-924fd6f7-9cb0-484f-90fe-7a464775c991 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190372 Aug 24 15:44:16.046194 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 557/1111] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:44:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:17.630854 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-381621538", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d6c1c2a-15ca-40ea-817f-c07314d99884"}], "security_groups": [{"name": "tempest-securitygroup--1156855237"}], "key_name": "tempest-keypair-1795333925", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:17.639794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.640580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:17.757837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] validate_networks() for [('2d6c1c2a-15ca-40ea-817f-c07314d99884', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:44:18.201275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:44:18.201957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:44:18.202824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:44:18.203326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:44:18.203762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:44:18.217150 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:18.218088 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:18.218739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:18.219635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:18.220163 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:18.220731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:18.240861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:44:18.245353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:44:18.257080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:44:18.259917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:44:18.326895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-352b6d3c-ecf6-456b-88a0-dbc6fd72dcaf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700235 Aug 24 15:44:18.327734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 555/1112] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:44:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 15:44:18.339174 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:18.347412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-930c3f2b-6536-47f7-806d-ff862d6a5cd8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:18.348596 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-930c3f2b-6536-47f7-806d-ff862d6a5cd8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:18.440093 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-930c3f2b-6536-47f7-806d-ff862d6a5cd8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:18.452755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-930c3f2b-6536-47f7-806d-ff862d6a5cd8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1241 microversion: 2.1 time: 0.115539 Aug 24 15:44:18.453338 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 558/1113] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:18 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:19.480415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:19.481434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:19.489895 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:19.490430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:19.490863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:19.491606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:19.492064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:19.492496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:19.558041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:19.566669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9221eee2-4ea7-4eff-a361-f917426db450 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1293 microversion: 2.1 time: 0.094529 Aug 24 15:44:19.567591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 556/1114] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:19 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:20.588948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:20.589537 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:20.596199 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:20.596681 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:20.597111 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:20.597900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:20.598686 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:20.599414 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:20.892389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:20.903394 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-08711bc8-98d9-4889-b662-ac9a85d37d8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.318177 Aug 24 15:44:20.904092 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 559/1115] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:20 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:21.221963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-27307309-42f9-4f98-b67d-bf56989ace1b req-80e1e3ed-e0be-4c9c-9b19-06e4d924738d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b1b45a-dd38-4867-bcd0-f748feba2464", "tag": "d30cd282-cf3f-4e16-876a-c151a4c98b17"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:21.232106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-27307309-42f9-4f98-b67d-bf56989ace1b req-80e1e3ed-e0be-4c9c-9b19-06e4d924738d service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:21.232587 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-27307309-42f9-4f98-b67d-bf56989ace1b req-80e1e3ed-e0be-4c9c-9b19-06e4d924738d service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:21.233022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-27307309-42f9-4f98-b67d-bf56989ace1b req-80e1e3ed-e0be-4c9c-9b19-06e4d924738d service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:21.245933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-27307309-42f9-4f98-b67d-bf56989ace1b req-80e1e3ed-e0be-4c9c-9b19-06e4d924738d service nova] Creating event network-changed:d30cd282-cf3f-4e16-876a-c151a4c98b17 for instance d3b1b45a-dd38-4867-bcd0-f748feba2464 on hv-cinder-84890 Aug 24 15:44:21.251087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-27307309-42f9-4f98-b67d-bf56989ace1b req-80e1e3ed-e0be-4c9c-9b19-06e4d924738d service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032738 Aug 24 15:44:21.251682 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 557/1116] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:44:21.926123 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:21.926766 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:21.933900 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:21.934427 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:21.934861 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:21.935548 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:21.936216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:21.936641 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:22.070202 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:22.077872 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-f48293a9-49b6-490b-be38-259e68eaf875 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.155650 Aug 24 15:44:22.078455 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 560/1117] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:21 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:23.100143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:23.100829 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:23.106965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.107442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.107883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.108571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:23.109017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:23.109443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:23.240775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:23.249019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a3abbed5-4ba4-4e81-97ad-f7551cf13f69 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.153695 Aug 24 15:44:23.249589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 558/1118] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:23 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:24.271935 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:24.272560 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:24.279898 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:24.280386 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:24.280823 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:24.281528 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:24.281986 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:24.282443 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:24.431972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:24.439973 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-bd2ef967-1f40-4fad-9c76-b17c0da2217b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.172404 Aug 24 15:44:24.440547 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 561/1119] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:24 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:25.461223 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:25.461821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:25.468244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:25.468742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:25.469161 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:25.469845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:25.470321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:25.470758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:25.616910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:25.625815 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bac905ac-d6ff-4eab-a8f5-24dc5e51bf03 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.168397 Aug 24 15:44:25.626434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 559/1120] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:25 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:26.646595 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:26.647172 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:26.654582 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:26.655066 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:26.655501 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:26.656216 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:26.656658 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:26.657080 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:26.795913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:26.803893 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-2792b62a-bf71-419c-91c1-011ec72e4c92 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.161268 Aug 24 15:44:26.804469 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 562/1121] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:26 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:27.828700 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:27.829776 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:27.839948 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.840755 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.841367 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.842806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.843594 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.844389 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.910742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-ac30b510-3424-4c50-ae8e-e66e5c267970 req-f4e8f6cc-34c5-4094-847e-54b0562b9ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b1b45a-dd38-4867-bcd0-f748feba2464", "name": "network-vif-plugged", "status": "completed", "tag": "d30cd282-cf3f-4e16-876a-c151a4c98b17"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:27.926183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ac30b510-3424-4c50-ae8e-e66e5c267970 req-f4e8f6cc-34c5-4094-847e-54b0562b9ee2 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:27.926700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ac30b510-3424-4c50-ae8e-e66e5c267970 req-f4e8f6cc-34c5-4094-847e-54b0562b9ee2 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:27.927129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ac30b510-3424-4c50-ae8e-e66e5c267970 req-f4e8f6cc-34c5-4094-847e-54b0562b9ee2 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:27.938924 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-ac30b510-3424-4c50-ae8e-e66e5c267970 req-f4e8f6cc-34c5-4094-847e-54b0562b9ee2 service nova] Creating event network-vif-plugged:d30cd282-cf3f-4e16-876a-c151a4c98b17 for instance d3b1b45a-dd38-4867-bcd0-f748feba2464 on hv-cinder-84890 Aug 24 15:44:27.944239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-ac30b510-3424-4c50-ae8e-e66e5c267970 req-f4e8f6cc-34c5-4094-847e-54b0562b9ee2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123999 Aug 24 15:44:27.945006 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 560/1122] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:44:28.021439 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:28.031305 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-06999a30-da5d-4abd-a19e-23e78e86b886 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.209211 Aug 24 15:44:28.032565 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 563/1123] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:27 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:44:29.052215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:29.053008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=6 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:29.057698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:29.058459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:29.065400 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:29.065878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:29.066544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:29.067041 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:29.067518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:29.067940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:29.198811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:29.206391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7e8e004b-36f0-4954-9ebe-0c1adf2510dd tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1367 microversion: 2.1 time: 0.155075 Aug 24 15:44:29.206948 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 561/1124] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:29 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:30.228160 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:30.228807 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:30.230626 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell0:SELECT=6 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:44:30.236460 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:30.236940 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:30.237376 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:30.238064 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:30.238549 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:30.238972 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:30.367051 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.policy [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120848) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:44:30.375033 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-3786c271-b9bf-48ec-881a-49009f0b3124 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1556 microversion: 2.1 time: 0.150837 Aug 24 15:44:30.375591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 564/1125] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:44:30 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:44:30.395967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:44:30.396358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:44:30.403428 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:30.403900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:30.404325 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:30.405005 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:30.405451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:30.405868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:30.489133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-78f4793c-ae04-475a-a75e-6b663e638aeb tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097200 Aug 24 15:44:30.489731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 562/1126] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:44:30 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:44:31.405606 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [req-4dd78c83-b8b0-4dc1-9402-d76597f9beb2 req-e81f9fe9-683c-4420-a5b5-5eceb4e254f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b1b45a-dd38-4867-bcd0-f748feba2464", "tag": "d30cd282-cf3f-4e16-876a-c151a4c98b17"}]} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:44:31.415341 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4dd78c83-b8b0-4dc1-9402-d76597f9beb2 req-e81f9fe9-683c-4420-a5b5-5eceb4e254f3 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:44:31.415923 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4dd78c83-b8b0-4dc1-9402-d76597f9beb2 req-e81f9fe9-683c-4420-a5b5-5eceb4e254f3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:44:31.416762 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [req-4dd78c83-b8b0-4dc1-9402-d76597f9beb2 req-e81f9fe9-683c-4420-a5b5-5eceb4e254f3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:44:31.430145 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.compute.server_external_events [req-4dd78c83-b8b0-4dc1-9402-d76597f9beb2 req-e81f9fe9-683c-4420-a5b5-5eceb4e254f3 service nova] Creating event network-changed:d30cd282-cf3f-4e16-876a-c151a4c98b17 for instance d3b1b45a-dd38-4867-bcd0-f748feba2464 on hv-cinder-84890 Aug 24 15:44:31.435994 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [req-4dd78c83-b8b0-4dc1-9402-d76597f9beb2 req-e81f9fe9-683c-4420-a5b5-5eceb4e254f3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034007 Aug 24 15:44:31.436886 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 565/1127] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:46.378884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:46.379544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=34 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:46.384548 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:45:46.385136 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:46.394045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:46.394652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:46.395111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:46.395787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:46.396228 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:46.396697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:46.421318 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3cd14668-a6ca-429c-b168-85f22a44e7f1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/ips" status: 200 len: 149 microversion: 2.1 time: 0.044446 Aug 24 15:45:46.421875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 563/1128] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:45:46 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:47.775741 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d3f44549-c404-4fa3-984e-0349ccbdc871] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 15:45:47.776343 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.777240 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG dbcounter [-] [120848] Writing DB stats nova_cell1:SELECT=38 {{(pid=120848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:47.781864 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68db6a90-1252-440c-9988-b12899cbddfb"}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:47.784215 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120848) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:45:47.791412 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:47.792149 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:47.792591 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:47.793286 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:47.793735 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:47.794158 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:48.784048 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] [d3f44549-c404-4fa3-984e-0349ccbdc871] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 34072. Aug 24 15:45:48.901032 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO nova.api.openstack.requestlog [None req-7c5007bc-b62a-42ea-ac19-5d7d2ff6fa65 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.127848 Aug 24 15:45:48.901826 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: [pid: 120848|app: 0|req: 566/1129] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:45:47 2022] POST /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments => generated 194 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:56.421255 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e70946cf-2505-459c-8194-27eea79b5b40 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: .version_select at 0x7f6659ef7940>, body: {"keypair": {"name": "tempest-keypair-174614765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV+/eg83EayVH/mvhNKLJ1dlM0tX1G3JWj4aGq8HTnvpt82p+lkOzBjOmVwv29i+diiPVmjcBmsHiGz9M+p7nOsWvAgRFTzQhs6imb8fqi7BMtFP4AzR0M6dg3322Mgpg=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:56.427641 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:56.428276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:45:56.440143 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-e70946cf-2505-459c-8194-27eea79b5b40 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:45:56.444183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-e70946cf-2505-459c-8194-27eea79b5b40 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:45:56.465613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e70946cf-2505-459c-8194-27eea79b5b40 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048371 Aug 24 15:45:56.466207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 564/1130] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:45:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:45:57.702698 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.api.openstack.wsgi [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-935362885", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d6c1c2a-15ca-40ea-817f-c07314d99884"}], "security_groups": [{"name": "tempest-securitygroup--1297517010"}], "key_name": "tempest-keypair-174614765", "user_data": "}} {{(pid=120848) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:45:57.813698 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.network.neutron [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] validate_networks() for [('2d6c1c2a-15ca-40ea-817f-c07314d99884', None, None, None, None, None)] {{(pid=120848) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:45:58.276447 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:45:58.276876 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image limits 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:45:58.277394 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:45:58.277806 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image pref 0:0:0 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:45:58.278258 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.virt.hardware [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120848) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:45:58.287487 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:58.287969 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:58.288408 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:58.289139 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:45:58.289598 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:45:58.290029 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG oslo_concurrency.lockutils [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120848) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:45:58.307335 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:45:58.311307 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.quota [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120848) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:45:58.322260 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Going to run 1 instances... {{(pid=120848) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:45:58.324571 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: DEBUG nova.compute.api [None req-77a35988-a2d9-42e4-8694-14324557b73f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 2b3eea6e-a857-4777-93dc-ff211322a76a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120848) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:46:34.242382 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:46:34.243125 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:46:36.545007 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:46:36.545492 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:46:57.796179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:57.796971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:46:57.801718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a342d403-8207-4b36-aa7e-42a93d50ebf3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '.version_select at 0x7f6659bb0c10>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:57.820554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a342d403-8207-4b36-aa7e-42a93d50ebf3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174614765" status: 202 len: 0 microversion: 2.1 time: 0.026345 Aug 24 15:46:57.821101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 565/1131] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 15:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174614765 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:46:58.489253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:58.489751 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:58.495704 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.496186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.496626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.497319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.497775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.498259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.577309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lazy-loading 'services' on Instance uuid d3b1b45a-dd38-4867-bcd0-f748feba2464 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:46:58.647697 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-78d85337-5453-4ef9-99ca-2897de50a736 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments/68db6a90-1252-440c-9988-b12899cbddfb" status: 202 len: 0 microversion: 2.1 time: 0.162686 Aug 24 15:46:58.648443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 566/1132] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:46:58 2022] DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments/68db6a90-1252-440c-9988-b12899cbddfb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:46:58.659077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:58.661335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:58.669656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.670142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.671104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.671797 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:58.672807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:58.673223 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:58.705942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-85dd2eda-79b1-425b-b8da-12f11da4fc29 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052041 Aug 24 15:46:58.706512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 567/1133] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:46:58 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:46:59.718319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:59.720417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:59.726744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.727217 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.727652 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.728332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.728778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.729199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.758841 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-95537b49-fbe1-4dcb-a2a0-22e306d60233 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044573 Aug 24 15:46:59.759379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 568/1134] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:46:59 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:46:59.820749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:59.821239 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:59.827085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.827556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.827986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.828663 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.829109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.829525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.853460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:46:59.931661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e12de79b-3290-4b4f-8024-da82f6340ab0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 204 len: 0 microversion: 2.1 time: 0.114297 Aug 24 15:46:59.932235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 569/1135] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:46:59 2022] DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:46:59.940936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:46:59.941665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:46:59.947471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.947979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.948406 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:46:59.949078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:46:59.949519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:46:59.949936 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:00.087049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:00.094964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-58685af1-b0fe-4eef-9569-19f98a246597 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1681 microversion: 2.1 time: 0.158259 Aug 24 15:47:00.095525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 570/1136] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:46:59 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:01.116755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:01.117450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:01.123738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:01.124237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:01.124668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:01.125944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:01.126430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:01.126855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:01.252169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:01.259890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3a011d2f-e1c5-43eb-8c69-cfe09a35617f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1681 microversion: 2.1 time: 0.147144 Aug 24 15:47:01.260458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 571/1137] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:01 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:02.281022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:02.281739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:02.288579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:02.289123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:02.289622 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:02.290367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:02.290815 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:02.291237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:02.358655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:02.366689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9e5fc4fe-cf0d-41d1-9dba-5558f1f153d8 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 200 len: 1613 microversion: 2.1 time: 0.089527 Aug 24 15:47:02.367291 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 572/1138] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:02 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:02.577289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-6e38e571-0e97-4de0-9301-2ccfd238e8e5 req-49fa884d-44f9-4a10-9668-a699420a2326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b1b45a-dd38-4867-bcd0-f748feba2464", "name": "network-vif-deleted", "tag": "d30cd282-cf3f-4e16-876a-c151a4c98b17"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:02.586691 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6e38e571-0e97-4de0-9301-2ccfd238e8e5 req-49fa884d-44f9-4a10-9668-a699420a2326 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:02.587136 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6e38e571-0e97-4de0-9301-2ccfd238e8e5 req-49fa884d-44f9-4a10-9668-a699420a2326 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:02.587564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6e38e571-0e97-4de0-9301-2ccfd238e8e5 req-49fa884d-44f9-4a10-9668-a699420a2326 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:02.599548 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-6e38e571-0e97-4de0-9301-2ccfd238e8e5 req-49fa884d-44f9-4a10-9668-a699420a2326 service nova] Creating event network-vif-deleted:d30cd282-cf3f-4e16-876a-c151a4c98b17 for instance d3b1b45a-dd38-4867-bcd0-f748feba2464 on hv-cinder-84890 Aug 24 15:47:02.604508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-6e38e571-0e97-4de0-9301-2ccfd238e8e5 req-49fa884d-44f9-4a10-9668-a699420a2326 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030765 Aug 24 15:47:02.605417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 573/1139] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:03.389141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:03.389837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:03.396097 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:03.396578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:03.397011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:03.397703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:03.398169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:03.398624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:03.412424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 HTTP/1.1 Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:47:03.414157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:47:03.415914 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'd3b1b45a-dd38-4867-bcd0-f748feba2464'} Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:47:03.416902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:47:03.418608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:47:03.419814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:47:03.419814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3620d1cc-7c77-427a-9023-58a52ace0e9b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 404 len: 111 microversion: 2.1 time: 0.031083 Aug 24 15:47:03.419814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 574/1140] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:03 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:47:03.424856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-31c86981-9e37-41d2-9896-d198dc5e92e5 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '.version_select at 0x7f66592a3040>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:03.443555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-31c86981-9e37-41d2-9896-d198dc5e92e5 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795333925" status: 202 len: 0 microversion: 2.1 time: 0.022884 Aug 24 15:47:03.444125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 575/1141] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 15:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795333925 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:47:04.068318 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-abc05c10-0b55-4652-9949-37df4b138842 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: .version_select at 0x7f6659bb03a0>, body: {"keypair": {"name": "tempest-keypair-1653186695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFdOTktrlz9il21tHAZQVn+LOSwerbEjSKQ1OfYG3oTBVTfRtqcPiqki67AhpG+NvXMnvCuDoLdJNzYx9VgxgXdhp2EA3mYtSl+p6AB3STehHESI7hlnhnORoHUyh0yHA=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:04.084987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-abc05c10-0b55-4652-9949-37df4b138842 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:04.089221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-abc05c10-0b55-4652-9949-37df4b138842 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:04.111134 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-abc05c10-0b55-4652-9949-37df4b138842 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046639 Aug 24 15:47:04.111718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 576/1142] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:47:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:05.324382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-974231767", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d6c1c2a-15ca-40ea-817f-c07314d99884"}], "security_groups": [{"name": "tempest-securitygroup--1486297310"}], "key_name": "tempest-keypair-1653186695", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:05.427387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] validate_networks() for [('2d6c1c2a-15ca-40ea-817f-c07314d99884', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:47:05.792576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:47:05.793257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:47:05.793768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:47:05.794174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:47:05.794620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:47:05.804973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:05.805446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:05.805878 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:05.806643 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:05.807095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:05.807517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:05.824280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:47:05.828206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:47:05.838946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:47:05.841234 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:47:05.887555 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-929e7a17-0bc7-4ed6-8785-1da18af8902c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567428 Aug 24 15:47:05.888118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 577/1143] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:47:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:47:05.898807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8d961f19-a365-45d0-ba0c-6247aca2b602 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:05.899422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8d961f19-a365-45d0-ba0c-6247aca2b602 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:05.957750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8d961f19-a365-45d0-ba0c-6247aca2b602 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:05.964738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8d961f19-a365-45d0-ba0c-6247aca2b602 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1241 microversion: 2.1 time: 0.069711 Aug 24 15:47:05.965298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 578/1144] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:05 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:06.986690 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:06.987386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:06.993983 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:06.994494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:06.994924 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:06.995620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:06.996064 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:06.996483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:07.061725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:07.069374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-03d2db61-62e1-4181-99fd-44214f5a79cf tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1299 microversion: 2.1 time: 0.087149 Aug 24 15:47:07.079312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 579/1145] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:06 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:08.090677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:08.091388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:08.098420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.098902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.099332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:08.100032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.100478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.100899 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:08.236224 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:08.244285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-53aa115b-d4a1-4e27-b8d7-ac0a095bf222 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.157310 Aug 24 15:47:08.244862 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 580/1146] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:08 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:08.350626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-c724665c-8650-402c-bd4a-04ab64d3755b req-15316340-341d-483c-b290-06449b85ead3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a8a364-ff3c-4cf2-81ed-b2bc716739f3", "tag": "239cfb25-c979-4cdc-9d69-6a2f226f8ef4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:08.362627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c724665c-8650-402c-bd4a-04ab64d3755b req-15316340-341d-483c-b290-06449b85ead3 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:08.363244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c724665c-8650-402c-bd4a-04ab64d3755b req-15316340-341d-483c-b290-06449b85ead3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:08.363780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c724665c-8650-402c-bd4a-04ab64d3755b req-15316340-341d-483c-b290-06449b85ead3 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:08.376109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-c724665c-8650-402c-bd4a-04ab64d3755b req-15316340-341d-483c-b290-06449b85ead3 service nova] Creating event network-changed:239cfb25-c979-4cdc-9d69-6a2f226f8ef4 for instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 on hv-cinder-84890 Aug 24 15:47:08.381394 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-c724665c-8650-402c-bd4a-04ab64d3755b req-15316340-341d-483c-b290-06449b85ead3 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034904 Aug 24 15:47:08.381997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 581/1147] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:47:09.267163 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:09.267879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:09.273922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:09.274446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:09.274882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.275569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:09.276017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:09.276443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:09.412197 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:09.420290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-888c223c-9814-4d0b-9de9-330963812411 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.158407 Aug 24 15:47:09.420851 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 582/1148] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:09 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:10.440861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:10.441564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:10.447375 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:10.447853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:10.448289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:10.448971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:10.449417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:10.449848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:10.584201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:10.591739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4c1bb839-7384-4442-a162-327b0c6671a9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.155868 Aug 24 15:47:10.592298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 583/1149] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:10 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:11.613230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:11.613832 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:11.620319 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:11.620803 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:11.621237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:11.621924 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:11.622408 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:11.622833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:11.751002 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:11.758599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d8586235-ef09-42c4-afb5-bdb576bce987 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.149178 Aug 24 15:47:11.759159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 584/1150] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:11 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:47:12.779506 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:12.780205 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:12.787030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:12.787507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:12.787944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:12.788629 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:12.789077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:12.789499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:12.925910 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:12.930076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:12.941969 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-588d351e-246b-48b1-a0c4-f3cd5e698a3a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.166239 Aug 24 15:47:12.942590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 585/1151] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:12 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:13.962570 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:13.963222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:13.970785 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:13.971264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:13.971698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:13.972381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:13.972828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:13.973249 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.103808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:14.111522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-478417b5-907b-4927-b9a5-a9f0dab53ce9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.153187 Aug 24 15:47:14.112086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 586/1152] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:13 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:14.566569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-c812c2c8-6176-43a4-a09f-492e85174dc8 req-01eecd6c-70e2-4829-85f2-7c859f6ce442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a8a364-ff3c-4cf2-81ed-b2bc716739f3", "name": "network-vif-plugged", "status": "completed", "tag": "239cfb25-c979-4cdc-9d69-6a2f226f8ef4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:14.576090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c812c2c8-6176-43a4-a09f-492e85174dc8 req-01eecd6c-70e2-4829-85f2-7c859f6ce442 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:14.576564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c812c2c8-6176-43a4-a09f-492e85174dc8 req-01eecd6c-70e2-4829-85f2-7c859f6ce442 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:14.576994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c812c2c8-6176-43a4-a09f-492e85174dc8 req-01eecd6c-70e2-4829-85f2-7c859f6ce442 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:14.589125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-c812c2c8-6176-43a4-a09f-492e85174dc8 req-01eecd6c-70e2-4829-85f2-7c859f6ce442 service nova] Creating event network-vif-plugged:239cfb25-c979-4cdc-9d69-6a2f226f8ef4 for instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 on hv-cinder-84890 Aug 24 15:47:14.594665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-c812c2c8-6176-43a4-a09f-492e85174dc8 req-01eecd6c-70e2-4829-85f2-7c859f6ce442 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Aug 24 15:47:14.595257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 587/1153] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:47:15.132809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:15.133455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:15.139498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:15.139973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:15.140945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:15.141623 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:15.142071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:15.142521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:15.354087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:15.362666 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5a8d9fe0-0611-4707-9bfe-9ff700969e8d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.234335 Aug 24 15:47:15.363370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 588/1154] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:15 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:16.389525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:16.391234 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:16.393281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:16.393998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=12 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:47:16.400867 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.401342 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.401769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.402484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:16.402933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:16.403354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:16.548388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:16.557279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4d27bb6a-0460-4a1a-af2c-09b422e87b9c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1367 microversion: 2.1 time: 0.172469 Aug 24 15:47:16.557844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 589/1155] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:16 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:17.576935 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:17.577582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:17.584010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.584480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.584907 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.585578 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.586022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.586459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.715274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:47:17.722860 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-bce5ee28-0aa3-4b0c-b3af-e7e5698cb99f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1557 microversion: 2.1 time: 0.149806 Aug 24 15:47:17.723420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 590/1156] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:47:17 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:47:17.744155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:47:17.744835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:47:17.751998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.752547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.753025 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.753773 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:17.754247 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:17.754661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:17.832687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1adaef5b-c35a-4a6e-828f-91d98e3b2326 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092971 Aug 24 15:47:17.833478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 591/1157] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:47:17 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:47:18.823331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-d69bc596-7a06-49f8-a362-5a325e20b901 req-a3ee28b6-ed84-4454-8238-eddff0b701c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a8a364-ff3c-4cf2-81ed-b2bc716739f3", "tag": "239cfb25-c979-4cdc-9d69-6a2f226f8ef4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:47:18.833274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-d69bc596-7a06-49f8-a362-5a325e20b901 req-a3ee28b6-ed84-4454-8238-eddff0b701c6 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:47:18.833748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-d69bc596-7a06-49f8-a362-5a325e20b901 req-a3ee28b6-ed84-4454-8238-eddff0b701c6 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:47:18.834181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-d69bc596-7a06-49f8-a362-5a325e20b901 req-a3ee28b6-ed84-4454-8238-eddff0b701c6 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:47:18.845359 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-d69bc596-7a06-49f8-a362-5a325e20b901 req-a3ee28b6-ed84-4454-8238-eddff0b701c6 service nova] Creating event network-changed:239cfb25-c979-4cdc-9d69-6a2f226f8ef4 for instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 on hv-cinder-84890 Aug 24 15:47:18.850274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-d69bc596-7a06-49f8-a362-5a325e20b901 req-a3ee28b6-ed84-4454-8238-eddff0b701c6 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087643 Aug 24 15:47:18.850871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 592/1158] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:23.443821 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:23.444571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=32 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:23.448911 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:23.449494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:23.457529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:23.458003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:23.458465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:23.459144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:23.459594 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:23.460012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:23.485269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6e19748e-29c9-42b5-8592-0bf1d4caa2ab tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/ips" status: 200 len: 149 microversion: 2.1 time: 0.043600 Aug 24 15:48:23.485824 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 593/1159] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:48:23 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:24.819276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:24.821614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:24.828658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.829134 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.829572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:24.830278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:24.830758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:24.831183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:25.067718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c5fe4916-e4cf-46a0-8a05-29dd292a6590 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252267 Aug 24 15:48:25.068678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 594/1160] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:48:24 2022] POST /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:32.613546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:32.615971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:32.622151 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.622863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.623289 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.623986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.624455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.624871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.704152 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Invalid volume: volume d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec is already attached to instances: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: POST /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments HTTP/1.1 Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 74 Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:48:32.705908 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {"volumeAttachment": {"volumeId": "d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec"}} Aug 24 15:48:32.707833 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Invalid volume: volume d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec is already attached to instances: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'server_id': 'e5a8a364-ff3c-4cf2-81ed-b2bc716739f3', 'body': {'volumeAttachment': {'volumeId': 'd8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec'}}} Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec is already attached to instances: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:32.708732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec is already attached to instances: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:32.710084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec is already attached to instances: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 400 to user: Invalid volume: volume d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec is already attached to instances: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0c8016ee-c04d-4854-895d-41a6dd5d19a4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098630 Aug 24 15:48:32.711440 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 595/1161] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:48:32 2022] POST /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 15:48:32.769676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:32.770188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:32.777050 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.777522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.777953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.779207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.779655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.780080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.857430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lazy-loading 'services' on Instance uuid e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:48:32.932986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8fd1b10f-1ffb-41e1-ac43-d8d5efe960e2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments/d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec" status: 202 len: 0 microversion: 2.1 time: 0.166902 Aug 24 15:48:32.933608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 596/1162] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:48:32 2022] DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments/d8a3e1be-5d93-46b8-a2e2-1d0ffd9f47ec => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:48:32.943080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:32.945206 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:32.953534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.954157 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.954632 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.955370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:32.955826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:32.956250 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:32.987327 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-eb20b5f1-516d-4f10-a6e0-05e2e21f5f02 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048542 Aug 24 15:48:32.988190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 597/1163] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:48:32 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:33.999300 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:34.001415 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:34.007823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.008288 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.008713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.009425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.009865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.010332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.038934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4d2267d6-1ea6-445f-ad25-46a0e87c6b46 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043592 Aug 24 15:48:34.039480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 598/1164] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:48:33 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:48:34.100500 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:34.100991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:34.107416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.107889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.108315 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.108990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.109434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.109856 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.134158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:48:34.210195 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-235487b7-19b2-483c-a296-151b7fbc322f tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 204 len: 0 microversion: 2.1 time: 0.113148 Aug 24 15:48:34.210938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 599/1165] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:48:34 2022] DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:48:34.219625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:34.220310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:34.226115 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.226643 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.227073 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.227746 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:34.228190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:34.228607 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:34.360481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:34.368120 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fd6dfccb-a2b5-4964-93d5-d02421fa4649 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1681 microversion: 2.1 time: 0.152494 Aug 24 15:48:34.368681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 600/1166] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:34 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:35.390101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:35.390817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:35.397100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.397581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.398014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.398731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:35.399180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:35.399603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:35.532574 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:35.540678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-273cf166-6454-4756-aa08-68e48ffeb02d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1681 microversion: 2.1 time: 0.154431 Aug 24 15:48:35.541321 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 601/1167] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:35 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:36.562125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:36.562847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:36.569281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:36.569761 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:36.570187 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:36.570902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:36.571354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:36.571827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:36.711031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:36.718659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-33baffef-0918-48af-bb57-24d89ac3f708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 200 len: 1681 microversion: 2.1 time: 0.160364 Aug 24 15:48:36.719218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 602/1168] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:36 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:37.050506 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-c75888af-c08b-49bb-a69d-03de40ffd3af req-cd99bf77-65ec-4934-8021-19ebb5fff19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a8a364-ff3c-4cf2-81ed-b2bc716739f3", "name": "network-vif-deleted", "tag": "239cfb25-c979-4cdc-9d69-6a2f226f8ef4"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:37.064902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c75888af-c08b-49bb-a69d-03de40ffd3af req-cd99bf77-65ec-4934-8021-19ebb5fff19f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.065684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c75888af-c08b-49bb-a69d-03de40ffd3af req-cd99bf77-65ec-4934-8021-19ebb5fff19f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.066154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-c75888af-c08b-49bb-a69d-03de40ffd3af req-cd99bf77-65ec-4934-8021-19ebb5fff19f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.080689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-c75888af-c08b-49bb-a69d-03de40ffd3af req-cd99bf77-65ec-4934-8021-19ebb5fff19f service nova] Creating event network-vif-deleted:239cfb25-c979-4cdc-9d69-6a2f226f8ef4 for instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 on hv-cinder-84890 Aug 24 15:48:37.086085 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-c75888af-c08b-49bb-a69d-03de40ffd3af req-cd99bf77-65ec-4934-8021-19ebb5fff19f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108839 Aug 24 15:48:37.090471 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 603/1169] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:37.742715 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:37.743428 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:37.750473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.750966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.751404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.752111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:37.752568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:37.752996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:37.767171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 HTTP/1.1 Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:48:37.768842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:48:37.770515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'e5a8a364-ff3c-4cf2-81ed-b2bc716739f3'} Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:48:37.771454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:48:37.772973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:48:37.774382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:48:37.774382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6eac1021-aa87-4ffe-ba3e-8f25606f63de tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 404 len: 111 microversion: 2.1 time: 0.032624 Aug 24 15:48:37.774382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 604/1170] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:37 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:48:37.779104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d1d3c620-6e3b-408d-a119-0d5af654e57c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '.version_select at 0x7f665924dc10>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:37.800116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d1d3c620-6e3b-408d-a119-0d5af654e57c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653186695" status: 202 len: 0 microversion: 2.1 time: 0.024629 Aug 24 15:48:37.800791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 605/1171] 10.222.0.76 () {58 vars in 1221 bytes} [Wed Aug 24 15:48:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653186695 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 15:48:38.416278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-73b3cd91-82ae-4bd7-b33e-540eb0206c25 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: .version_select at 0x7f6659c0e0d0>, body: {"keypair": {"name": "tempest-keypair-732329097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSHcCM95u+vlU1xejmpI/jcFC94K2W/ld8HmO1gp8Jt8t2naUPm7KuNxHis8l7vNHo0B1dmqXx1zDHJ5XBKcmR0LBaJuEuFttt0UxnOvLfrXnyOeq1igvwpBs0k4DZmXw=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:38.432601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-73b3cd91-82ae-4bd7-b33e-540eb0206c25 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:38.436839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-73b3cd91-82ae-4bd7-b33e-540eb0206c25 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:38.458763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-73b3cd91-82ae-4bd7-b33e-540eb0206c25 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046351 Aug 24 15:48:38.459355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 606/1172] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:48:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:39.309237 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:48:39.309913 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:48:39.932929 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-847937736", "imageRef": "f9e044b7-4951-4e9f-bf89-f63b1529acce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d6c1c2a-15ca-40ea-817f-c07314d99884"}], "security_groups": [{"name": "tempest-securitygroup--1279541596"}], "key_name": "tempest-keypair-732329097", "user_data": "}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:40.037554 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] validate_networks() for [('2d6c1c2a-15ca-40ea-817f-c07314d99884', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:48:40.459287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:48:40.461275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:48:40.461275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:48:40.461275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:48:40.461275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:48:40.470504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.470985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.471422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.472150 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:40.472600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:40.473024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:40.490086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:48:40.494026 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Getting quotas for user 1f1ba27117d54534b9b423df00d43aa1 and project c07806353e51499b99117ea363f78b0c. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:48:40.505133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:48:40.507476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9e044b7-4951-4e9f-bf89-f63b1529acce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:48:40.554034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-36f994e8-4596-41de-b34d-0d5eeaefa84d tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625765 Aug 24 15:48:40.554765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 607/1173] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:48:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:48:40.565906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1f6724b1-276d-43ea-b46e-53c3f942e2f0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:40.566545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1f6724b1-276d-43ea-b46e-53c3f942e2f0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:40.624768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1f6724b1-276d-43ea-b46e-53c3f942e2f0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:40.632388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1f6724b1-276d-43ea-b46e-53c3f942e2f0 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1240 microversion: 2.1 time: 0.070158 Aug 24 15:48:40.633282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 608/1174] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:40 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:41.652808 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:41.654114 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:41.660388 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.660865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.661299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.661982 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:41.662466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:41.662891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:41.725308 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:41.733104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f9022229-e4a6-40e8-8b87-68a77868576b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1298 microversion: 2.1 time: 0.084084 Aug 24 15:48:41.733674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 609/1175] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:41 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:42.754114 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:42.754789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:42.761060 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.761535 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.761986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.763274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.763724 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.764137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.909227 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:42.916915 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ef6957ed-cd88-4fc3-a849-478a8db7dbf1 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.166643 Aug 24 15:48:42.930269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 610/1176] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:42 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:42.935800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-14471179-9497-46cf-b719-30df231225a5 req-43b35165-4966-41c5-a8b9-44b96fbe89e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c4f8bb-31d6-4fec-b869-e58d5e336d7c", "tag": "4aa1a847-725d-4278-ac69-48934d1b6818"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:42.945524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-14471179-9497-46cf-b719-30df231225a5 req-43b35165-4966-41c5-a8b9-44b96fbe89e1 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:42.946001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-14471179-9497-46cf-b719-30df231225a5 req-43b35165-4966-41c5-a8b9-44b96fbe89e1 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:42.946460 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-14471179-9497-46cf-b719-30df231225a5 req-43b35165-4966-41c5-a8b9-44b96fbe89e1 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:42.950598 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:42.959689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-14471179-9497-46cf-b719-30df231225a5 req-43b35165-4966-41c5-a8b9-44b96fbe89e1 service nova] Creating event network-changed:4aa1a847-725d-4278-ac69-48934d1b6818 for instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c on hv-cinder-84890 Aug 24 15:48:42.965095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-14471179-9497-46cf-b719-30df231225a5 req-43b35165-4966-41c5-a8b9-44b96fbe89e1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033520 Aug 24 15:48:42.965807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 611/1177] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:48:43.937924 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:43.938716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:43.945620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.946097 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.946588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:43.947273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:43.947725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:43.948144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:44.080459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:44.088128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1587f4b2-2365-44a5-a60e-a2dfc33715b4 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.154821 Aug 24 15:48:44.088687 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 612/1178] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:43 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:45.109111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:45.109789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:45.116204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.116686 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.117122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.117806 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:45.118281 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:45.118711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:45.249452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:45.257369 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ebc751a8-7029-43ef-9634-2d927ba22b1c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.152205 Aug 24 15:48:45.257925 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 613/1179] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:45 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:48:46.278129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:46.278901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:46.285826 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:46.286420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:46.286863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:46.287621 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:46.288126 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:46.288596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:46.419723 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:46.427434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-04159fd9-b757-42a9-98a0-a53a84e7d832 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.153199 Aug 24 15:48:46.427994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 614/1180] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:46 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:47.449092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:47.449880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:47.457078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.457556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.457987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.458705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:47.459148 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:47.459702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:47.596918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:47.605420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-62eda16b-6ffd-4bbf-b3e5-f84e8e7ca294 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.160404 Aug 24 15:48:47.606026 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 615/1181] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:47 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:48.627274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:48.627961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:48.633741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.634208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.634674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.635360 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:48.635805 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:48.636221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:48.765765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:48.773407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-13a36d7c-354f-4c40-9d88-db4d057f996a tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.150532 Aug 24 15:48:48.773974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 616/1182] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:48 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:49.046658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-1767144f-ef61-4b67-b1a8-430949816693 req-b19cdc27-14b6-4cd4-b4c3-b23fdd70ffc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c4f8bb-31d6-4fec-b869-e58d5e336d7c", "name": "network-vif-plugged", "status": "completed", "tag": "4aa1a847-725d-4278-ac69-48934d1b6818"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:49.057509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1767144f-ef61-4b67-b1a8-430949816693 req-b19cdc27-14b6-4cd4-b4c3-b23fdd70ffc5 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.058080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1767144f-ef61-4b67-b1a8-430949816693 req-b19cdc27-14b6-4cd4-b4c3-b23fdd70ffc5 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.058713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-1767144f-ef61-4b67-b1a8-430949816693 req-b19cdc27-14b6-4cd4-b4c3-b23fdd70ffc5 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:49.073170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-1767144f-ef61-4b67-b1a8-430949816693 req-b19cdc27-14b6-4cd4-b4c3-b23fdd70ffc5 service nova] Creating event network-vif-plugged:4aa1a847-725d-4278-ac69-48934d1b6818 for instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c on hv-cinder-84890 Aug 24 15:48:49.078473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-1767144f-ef61-4b67-b1a8-430949816693 req-b19cdc27-14b6-4cd4-b4c3-b23fdd70ffc5 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036423 Aug 24 15:48:49.079260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 617/1183] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:49.795890 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:49.796541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:49.803135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.803613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.804051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:49.804742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:49.805192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:49.805616 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:49.939389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:49.951849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ea580abc-a846-4c8f-b279-d2d69d98bcce tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.160523 Aug 24 15:48:49.952424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 618/1184] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:49 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:50.972875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:50.973542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:50.975485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:50.976273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=12 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:50.982963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:50.984231 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:50.984866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:50.985739 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:50.986199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:50.986653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:51.121614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:51.129668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-046610ae-44d2-46e9-899f-8e18ef2f1d93 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1366 microversion: 2.1 time: 0.160631 Aug 24 15:48:51.130335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 619/1185] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:50 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:52.151442 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:52.152128 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:52.159173 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.159655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.160090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.160780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.161226 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.161646 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.291230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:48:52.299529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-084dd6af-d578-4487-83eb-2db9144b269b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1555 microversion: 2.1 time: 0.151954 Aug 24 15:48:52.300102 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 620/1186] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:48:52 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:48:52.319268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:48:52.319762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:48:52.326398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.326877 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.327307 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.327997 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:52.328438 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:52.328855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:52.643784 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e86287a8-3b74-4177-82a3-52f170e9cc55 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.328195 Aug 24 15:48:52.644367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 621/1187] 10.222.0.76 () {58 vars in 1275 bytes} [Wed Aug 24 15:48:52 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:48:53.567241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-16209a4f-06dd-4afc-8aa7-2f927a583f27 req-b18076fe-9d0b-49c4-bca3-29b58193890f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c4f8bb-31d6-4fec-b869-e58d5e336d7c", "tag": "4aa1a847-725d-4278-ac69-48934d1b6818"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:48:53.572468 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:48:53.578545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-16209a4f-06dd-4afc-8aa7-2f927a583f27 req-b18076fe-9d0b-49c4-bca3-29b58193890f service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:48:53.579023 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-16209a4f-06dd-4afc-8aa7-2f927a583f27 req-b18076fe-9d0b-49c4-bca3-29b58193890f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:48:53.579456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-16209a4f-06dd-4afc-8aa7-2f927a583f27 req-b18076fe-9d0b-49c4-bca3-29b58193890f service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:48:53.593445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-16209a4f-06dd-4afc-8aa7-2f927a583f27 req-b18076fe-9d0b-49c4-bca3-29b58193890f service nova] Creating event network-changed:4aa1a847-725d-4278-ac69-48934d1b6818 for instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c on hv-cinder-84890 Aug 24 15:48:53.598844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-16209a4f-06dd-4afc-8aa7-2f927a583f27 req-b18076fe-9d0b-49c4-bca3-29b58193890f service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035039 Aug 24 15:48:53.599668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 622/1188] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:49:54.250839 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:49:54.251471 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:50:08.546486 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=56 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:50:08.599067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:08.599659 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:08.605842 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.606377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.606812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.607504 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:08.608610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:08.609076 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:08.631483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9016bedf-fae9-4584-b990-faa0fb409d68 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/ips" status: 200 len: 149 microversion: 2.1 time: 0.088181 Aug 24 15:50:08.632030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 623/1189] 10.222.0.76 () {58 vars in 1248 bytes} [Wed Aug 24 15:50:08 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:09.961676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "590f0319-0749-4b4f-9ee5-d417bcec99a3"}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:09.964159 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:09.970590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.971070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.971505 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:09.972192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:09.972642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:09.973067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:10.210394 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-dd152d3f-6cb6-47cf-9660-ddbf5ef24107 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "POST /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252770 Aug 24 15:50:10.210998 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 624/1190] 10.222.0.76 () {60 vars in 1323 bytes} [Wed Aug 24 15:50:09 2022] POST /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:17.827605 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:17.828214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:17.834310 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.834837 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.835275 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.835968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:17.836421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:17.836849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:17.920358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lazy-loading 'services' on Instance uuid 86c4f8bb-31d6-4fec-b869-e58d5e336d7c {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:50:17.991250 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-88c8ad53-aee6-4cac-b719-838bd7259708 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments/590f0319-0749-4b4f-9ee5-d417bcec99a3" status: 202 len: 0 microversion: 2.1 time: 0.168351 Aug 24 15:50:17.991827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 625/1191] 10.222.0.76 () {58 vars in 1416 bytes} [Wed Aug 24 15:50:17 2022] DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments/590f0319-0749-4b4f-9ee5-d417bcec99a3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:50:18.003480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:18.007527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:18.016204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.016713 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.017146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.017843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:18.018387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:18.018804 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:18.048720 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-02a19f44-2854-4c8e-af94-055e6bf78973 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052255 Aug 24 15:50:18.049280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 626/1192] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:50:17 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:19.060644 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.062832 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.069357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.069839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.070294 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.071000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.071445 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.071866 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.100358 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ac863b01-77c1-40fd-8062-5e868941b11c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043737 Aug 24 15:50:19.100915 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 627/1193] 10.222.0.76 () {58 vars in 1302 bytes} [Wed Aug 24 15:50:19 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 15:50:19.162961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.163456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.169624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.170794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.171237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.171920 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.172371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.172792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.196624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:50:19.269430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1608c18d-0336-493f-9104-a93b45bd8ba9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 204 len: 0 microversion: 2.1 time: 0.109913 Aug 24 15:50:19.270011 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 628/1194] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:19 2022] DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:50:19.278453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:19.279155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:19.285661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.286139 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.286613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.287295 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:19.287744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:19.288167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:19.421674 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:19.429278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2df695da-c5e9-4b82-83dd-c267471f4e44 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1680 microversion: 2.1 time: 0.154963 Aug 24 15:50:19.429841 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 629/1195] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:19 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:20.450423 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:20.451113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:20.457572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.458047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.458512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.459194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:20.459642 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:20.460061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:20.586135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:20.594286 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8991fd08-d08a-4fda-a6e4-94e4a1173261 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1680 microversion: 2.1 time: 0.147721 Aug 24 15:50:20.594852 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 630/1196] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:20 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:21.616214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:21.616903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:21.625395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.625939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.626403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.627092 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:21.627538 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:21.627957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:21.764329 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ba27117d54534b9b423df00d43aa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07806353e51499b99117ea363f78b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:50:21.772050 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-44aebed6-ac5f-48f2-944c-9ee626dd2d04 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 200 len: 1680 microversion: 2.1 time: 0.159709 Aug 24 15:50:21.772619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 631/1197] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:21 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:50:21.995516 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-6fff3a7f-06eb-4c07-8238-d7dc905d13a8 req-9cbc87b5-95a4-44f6-8594-87db76f1980a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c4f8bb-31d6-4fec-b869-e58d5e336d7c", "name": "network-vif-deleted", "tag": "4aa1a847-725d-4278-ac69-48934d1b6818"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:50:22.005458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6fff3a7f-06eb-4c07-8238-d7dc905d13a8 req-9cbc87b5-95a4-44f6-8594-87db76f1980a service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.005933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6fff3a7f-06eb-4c07-8238-d7dc905d13a8 req-9cbc87b5-95a4-44f6-8594-87db76f1980a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.006379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-6fff3a7f-06eb-4c07-8238-d7dc905d13a8 req-9cbc87b5-95a4-44f6-8594-87db76f1980a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.020377 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-6fff3a7f-06eb-4c07-8238-d7dc905d13a8 req-9cbc87b5-95a4-44f6-8594-87db76f1980a service nova] Creating event network-vif-deleted:4aa1a847-725d-4278-ac69-48934d1b6818 for instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c on hv-cinder-84890 Aug 24 15:50:22.025174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-6fff3a7f-06eb-4c07-8238-d7dc905d13a8 req-9cbc87b5-95a4-44f6-8594-87db76f1980a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Aug 24 15:50:22.025772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 632/1198] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:50:22.793989 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:22.795546 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:22.802499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.802988 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.803483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.804113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:22.804560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:22.804990 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:22.818858 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c HTTP/1.1 Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:22.820494 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:22.822174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '86c4f8bb-31d6-4fec-b869-e58d5e336d7c'} Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:22.823451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:22.825113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:22.826809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:22.826809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d8cce590-70b9-483a-9b56-b239ec42dc4b tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 404 len: 111 microversion: 2.1 time: 0.032624 Aug 24 15:50:22.826809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 633/1199] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:22 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:22.830429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-0289c537-275d-4c4b-aae6-cb5da7834e7c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '.version_select at 0x7f66592b85e0>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:22.849970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-0289c537-275d-4c4b-aae6-cb5da7834e7c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-732329097" status: 202 len: 0 microversion: 2.1 time: 0.023127 Aug 24 15:50:22.850563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 634/1200] 10.222.0.76 () {58 vars in 1218 bytes} [Wed Aug 24 15:50:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-732329097 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:50:24.603707 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:24.604299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:24.611480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:24.611958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:24.612391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:24.613071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:24.613527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:24.613951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:24.627352 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c HTTP/1.1 Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:24.628861 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.630635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '86c4f8bb-31d6-4fec-b869-e58d5e336d7c'} Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:24.631762 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.633403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.635314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:24.635314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3aa28329-de88-4dfa-b198-982af1ece6c3 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 404 len: 111 microversion: 2.1 time: 0.030828 Aug 24 15:50:24.635314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 635/1201] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:24 2022] DELETE /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:24.637964 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:24.638612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: 86c4f8bb-31d6-4fec-b869-e58d5e336d7c] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:24.644017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:24.644491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:24.644922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:24.645597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:24.646051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:24.646498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:24.659274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c HTTP/1.1 Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:24.660836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.662562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '86c4f8bb-31d6-4fec-b869-e58d5e336d7c'} Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:24.663565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. Aug 24 15:50:24.664857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:24.666414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance 86c4f8bb-31d6-4fec-b869-e58d5e336d7c could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:24.666414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f50f9b29-9a2c-465e-a021-ebc550f61a2e tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c" status: 404 len: 111 microversion: 2.1 time: 0.027559 Aug 24 15:50:24.666414 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 636/1202] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:24 2022] GET /compute/v2.1/servers/86c4f8bb-31d6-4fec-b869-e58d5e336d7c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:25.801800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:25.802405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:25.808771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:25.809254 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:25.809688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:25.810947 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:25.811398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:25.811823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:25.824993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 HTTP/1.1 Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:25.827188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.828927 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'e5a8a364-ff3c-4cf2-81ed-b2bc716739f3'} Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:25.830067 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.831795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.833485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:25.833485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4c8b9001-c7c2-44b3-a77b-a0d67ea089d9 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 404 len: 111 microversion: 2.1 time: 0.031174 Aug 24 15:50:25.833485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 637/1203] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:25 2022] DELETE /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:25.836559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:25.837170 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: e5a8a364-ff3c-4cf2-81ed-b2bc716739f3] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:25.842767 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:25.843246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:25.843678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:25.844357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:25.844807 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:25.845232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:25.858547 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 HTTP/1.1 Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:25.860031 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.861802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'e5a8a364-ff3c-4cf2-81ed-b2bc716739f3'} Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:25.862835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. Aug 24 15:50:25.864473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:25.865885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:25.865885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1717d3ec-aa85-4dc2-acde-2f10a044ef52 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3" status: 404 len: 111 microversion: 2.1 time: 0.028310 Aug 24 15:50:25.865885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 638/1204] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:25 2022] GET /compute/v2.1/servers/e5a8a364-ff3c-4cf2-81ed-b2bc716739f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:50:26.996455 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:26.997068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:27.003274 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:27.003768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:27.004183 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:27.004958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:27.005405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:27.005827 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:27.019478 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 HTTP/1.1 Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:27.020996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.022971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'd3b1b45a-dd38-4867-bcd0-f748feba2464'} Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:27.024141 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.025965 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.027705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:27.027705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ac096c7e-2367-4911-9ad0-15061e0860f2 tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 404 len: 111 microversion: 2.1 time: 0.029742 Aug 24 15:50:27.027705 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 639/1205] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:50:26 2022] DELETE /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:50:27.030857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:50:27.031462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] [instance: d3b1b45a-dd38-4867-bcd0-f748feba2464] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:50:27.037094 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:27.037572 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:27.038005 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:27.038726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:50:27.039175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:50:27.039599 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:50:27.052550 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] HTTP exception thrown: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Request method failure captured: Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 HTTP/1.1 Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkdPojQeYGryX8n6Ab3zWxhxyD-FYCe30Z_EJ9rkakoNVfZHEbU2SLoawjtmrW5AXWCmfuwneeGQLH6Q4kwsKE9VpLdJqQmLnfTBA3tsLoyNr7T7I122ZPmqQgEIEbWRUfUwtnnNsQYXd70fJsfcq13gvdTJfXS8d6RDG2a2zdi2M_s Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:50:27.054016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/c07806353e51499b99117ea363f78b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_c07806353e51499b99117ea363f78b0c", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/c07806353e51499b99117ea363f78b0c"}]}] Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: c07806353e51499b99117ea363f78b0c Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1363427760 Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1f1ba27117d54534b9b423df00d43aa1 Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-AttachVolumeNegativeTest-1363427760-project Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.055917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': 'd3b1b45a-dd38-4867-bcd0-f748feba2464'} Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:50:27.056905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. Aug 24 15:50:27.058563 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:50:27.060175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] Returning 404 to user: Instance d3b1b45a-dd38-4867-bcd0-f748feba2464 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:50:27.060175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b1ba1dbf-916d-4a65-bd7f-72b662e4c80c tempest-AttachVolumeNegativeTest-1363427760 tempest-AttachVolumeNegativeTest-1363427760-project] 10.222.0.76 "GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464" status: 404 len: 111 microversion: 2.1 time: 0.028555 Aug 24 15:50:27.060175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 640/1206] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:50:27 2022] GET /compute/v2.1/servers/d3b1b45a-dd38-4867-bcd0-f748feba2464 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:51:36.555597 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:51:36.556617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:51:51.325789 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:51.326550 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:51:51.499314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a29824aa-0c66-429d-bdaa-1fc05402c29a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Action: 'create', calling method: .version_select at 0x7f6659bf8280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1806751018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBCqalmqXWB5cvJnS0aW0GcC7G+UolirWm2qMGLUKckuRjXLw9HURWSWH7IeKOh5PFh6j1NYXm+t0mLXRov+OfJVWv3OA3ZNVZNyO49opviwQrngwPR/PBFdmMFLgigfg=="}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:51:51.514996 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-a29824aa-0c66-429d-bdaa-1fc05402c29a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for project ae3022891c914ea18ffacc414b55fb7e. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:51:51.518765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-a29824aa-0c66-429d-bdaa-1fc05402c29a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for user 1151eb3a305e4c18b8cc5717379bce63 and project ae3022891c914ea18ffacc414b55fb7e. Resources: {'key_pairs'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:51:51.540714 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a29824aa-0c66-429d-bdaa-1fc05402c29a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.216638 Aug 24 15:51:51.541309 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 641/1207] 10.222.0.76 () {60 vars in 1159 bytes} [Wed Aug 24 15:51:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:51:59.319719 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:51:59.320351 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:51:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:52:10.932116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:10.932860 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:10.936795 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-656770414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1806751018", "security_groups": [{"name": "tempest-secgroup-smoke-1866202252"}], "block_device_mapping_v2": [{"uuid": "7f8ff1e9-9255-43ea-a214-097ea3484921", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca94763a-7a29-4e38-a07a-e4db5955b3c4"}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:11.061106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] validate_networks() for [('ca94763a-7a29-4e38-a07a-e4db5955b3c4', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:52:11.425063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:52:11.425491 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:52:11.425984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:52:11.426429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:52:11.426873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:52:11.435593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.436070 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.436501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.437221 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:11.437668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:11.438179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:11.454306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for project ae3022891c914ea18ffacc414b55fb7e. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:52:11.458453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for user 1151eb3a305e4c18b8cc5717379bce63 and project ae3022891c914ea18ffacc414b55fb7e. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:52:11.515074 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:52:11.517261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f8ff1e9-9255-43ea-a214-097ea3484921',volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:52:11.644017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6a8715c3-5b43-4a7e-898c-ce0cc214dc3f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713183 Aug 24 15:52:11.644641 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 642/1208] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:52:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:52:11.655144 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-c5617323-6013-43eb-a4f5-2b343d1a4dea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:11.655909 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-c5617323-6013-43eb-a4f5-2b343d1a4dea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:11.710154 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-c5617323-6013-43eb-a4f5-2b343d1a4dea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:11.716960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-c5617323-6013-43eb-a4f5-2b343d1a4dea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1094 microversion: 2.1 time: 0.065386 Aug 24 15:52:11.717523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 643/1209] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:11 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:12.738453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-98d997ef-e6e6-480d-b7ab-20c977f98e9b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:12.739146 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-98d997ef-e6e6-480d-b7ab-20c977f98e9b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:12.792738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-98d997ef-e6e6-480d-b7ab-20c977f98e9b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:12.800841 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-98d997ef-e6e6-480d-b7ab-20c977f98e9b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1094 microversion: 2.1 time: 0.066307 Aug 24 15:52:12.801404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 644/1210] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:12 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:13.821677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-58e20845-c7fb-4827-ba29-8e3069b713a0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:13.822391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-58e20845-c7fb-4827-ba29-8e3069b713a0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:13.874779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-58e20845-c7fb-4827-ba29-8e3069b713a0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:13.881738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-58e20845-c7fb-4827-ba29-8e3069b713a0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1094 microversion: 2.1 time: 0.063962 Aug 24 15:52:13.882331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 645/1211] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:13 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:14.902230 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:14.902916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:14.911001 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:14.911483 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:14.911922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:14.912609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:14.913062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:14.913489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:15.082724 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:15.091830 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-959713fc-5d47-4ccd-9f06-5f7323261741 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1210 microversion: 2.1 time: 0.193387 Aug 24 15:52:15.092461 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 646/1212] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:14 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:16.066698 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-036a9e70-aee7-486a-8bff-41b071844b25 req-f763a99a-f47e-4d37-92b9-f3e7b344733a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c07a8d9-5110-4802-8abf-7c455e92f1a9", "tag": "d4f21594-9658-4ae7-9230-c7fb2c959577"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:16.080335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-036a9e70-aee7-486a-8bff-41b071844b25 req-f763a99a-f47e-4d37-92b9-f3e7b344733a service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.080811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-036a9e70-aee7-486a-8bff-41b071844b25 req-f763a99a-f47e-4d37-92b9-f3e7b344733a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.081451 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-036a9e70-aee7-486a-8bff-41b071844b25 req-f763a99a-f47e-4d37-92b9-f3e7b344733a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.093012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-036a9e70-aee7-486a-8bff-41b071844b25 req-f763a99a-f47e-4d37-92b9-f3e7b344733a service nova] Creating event network-changed:d4f21594-9658-4ae7-9230-c7fb2c959577 for instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 on hv-cinder-84890 Aug 24 15:52:16.098296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-036a9e70-aee7-486a-8bff-41b071844b25 req-f763a99a-f47e-4d37-92b9-f3e7b344733a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036364 Aug 24 15:52:16.098891 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 647/1213] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:16.114259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:16.114259 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:16.120453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.120930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.121359 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.122051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:16.122519 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:16.122938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:16.256949 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:16.264835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-622bf120-ac51-4ca0-a9fa-3cf5c61af5b0 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.155650 Aug 24 15:52:16.265402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 648/1214] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:16 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:17.285389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:17.286736 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:17.293175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.293658 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.294086 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.294822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:17.295269 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:17.295952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:17.430071 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:17.438356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5fa47fd6-85a9-4b96-a024-4e6026f5b7f7 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.156860 Aug 24 15:52:17.439179 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 649/1215] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:17 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:18.459792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:18.460512 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:18.466804 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:18.467284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:18.467718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:18.468405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:18.468859 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:18.469865 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:18.601081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:18.608679 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-81a24c8e-f79a-461b-a650-f59982443149 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.152919 Aug 24 15:52:18.609246 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 650/1216] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:18 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:19.629778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:19.630557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:19.636934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:19.637410 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:19.637844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.638565 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:19.639016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:19.639439 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:19.775091 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:19.783119 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d4402b2d-dfb8-49e1-acfe-7de0c6718016 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.157193 Aug 24 15:52:19.783620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 651/1217] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:19 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:20.804180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:20.804799 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:20.811131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.811612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.812045 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.813357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:20.813809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:20.814257 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:20.949137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:20.956710 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-826ac5cb-97f0-4f29-8bec-18241929654e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.156453 Aug 24 15:52:20.957264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 652/1218] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:20 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:21.976955 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:21.977630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:21.979549 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:21.985114 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:21.985585 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:21.986010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:21.986718 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:21.987162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:21.987581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:22.117701 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:22.125945 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e4d8fcef-2a47-4d9c-a1d4-a5203e95d18f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.152189 Aug 24 15:52:22.126626 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 653/1219] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:21 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:23.153373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:23.154008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:23.160341 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.160816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.161248 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.161933 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:23.162418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:23.162839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:23.296068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:23.304168 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-012d83cd-08f7-4983-8a82-dd673986537a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.154730 Aug 24 15:52:23.304726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 654/1220] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:23 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:24.324787 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:24.325436 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:24.327276 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=12 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:52:24.333501 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.333982 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.334454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.335140 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:24.335588 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:24.336012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:24.465496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:24.473816 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5e2442c3-0890-482b-9466-eabd426e475e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.152817 Aug 24 15:52:24.474407 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 655/1221] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:24 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:25.494946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:25.495625 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:25.502479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:25.502966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:25.503405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.504105 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:25.504562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:25.505020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:25.638614 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:25.647328 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-09fbd52f-394d-4437-97ac-3f80aaa5b000 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.156221 Aug 24 15:52:25.648189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 656/1222] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:25 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:26.091090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-eb0ca156-51e6-4112-b91b-62c5c228bd62 req-3f69b6dd-fb12-4e6f-af3f-09af92f35092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c07a8d9-5110-4802-8abf-7c455e92f1a9", "name": "network-vif-plugged", "status": "completed", "tag": "d4f21594-9658-4ae7-9230-c7fb2c959577"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:26.100952 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-eb0ca156-51e6-4112-b91b-62c5c228bd62 req-3f69b6dd-fb12-4e6f-af3f-09af92f35092 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.101522 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-eb0ca156-51e6-4112-b91b-62c5c228bd62 req-3f69b6dd-fb12-4e6f-af3f-09af92f35092 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.102022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-eb0ca156-51e6-4112-b91b-62c5c228bd62 req-3f69b6dd-fb12-4e6f-af3f-09af92f35092 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.116202 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-eb0ca156-51e6-4112-b91b-62c5c228bd62 req-3f69b6dd-fb12-4e6f-af3f-09af92f35092 service nova] Creating event network-vif-plugged:d4f21594-9658-4ae7-9230-c7fb2c959577 for instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 on hv-cinder-84890 Aug 24 15:52:26.121515 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-eb0ca156-51e6-4112-b91b-62c5c228bd62 req-3f69b6dd-fb12-4e6f-af3f-09af92f35092 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091800 Aug 24 15:52:26.122117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 657/1223] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:52:26.674730 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:26.675434 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:26.681517 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.681995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.682464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.683155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:26.683608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:26.684032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:26.820297 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:26.827941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d411157b-405c-4d5a-9ee8-6fe5a6c3fc05 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.158762 Aug 24 15:52:26.828798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 658/1224] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:26 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:27.849521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:27.850198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:27.856590 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.857065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.857499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.858182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:27.858656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:27.859079 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:27.992447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:28.001051 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f5de4bfc-f350-4166-b381-809e64bf2525 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1266 microversion: 2.1 time: 0.155916 Aug 24 15:52:28.001654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 659/1225] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:27 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:29.022178 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:29.022848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:29.029104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.029579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.030008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.030738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.031190 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.031612 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.162088 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:29.169683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-20dde6fd-9196-4160-b550-642150ba190e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1453 microversion: 2.1 time: 0.151339 Aug 24 15:52:29.170264 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 660/1226] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:29 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:52:29.190883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:52:29.191489 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:52:29.197490 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.197969 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.198429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.199118 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:29.199569 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:29.199991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:29.330946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:52:29.338638 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e3fe877b-edf5-4490-8260-ffc37f9acc83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1453 microversion: 2.1 time: 0.152565 Aug 24 15:52:29.339198 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 661/1227] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:52:29 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:52:30.973353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-17cbe7d2-d61b-4eb7-9e87-f9d1198a1b5c req-c954c0b1-7023-4b5c-b695-75d273901d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c07a8d9-5110-4802-8abf-7c455e92f1a9", "tag": "d4f21594-9658-4ae7-9230-c7fb2c959577"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:52:30.984107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-17cbe7d2-d61b-4eb7-9e87-f9d1198a1b5c req-c954c0b1-7023-4b5c-b695-75d273901d41 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:52:30.984589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-17cbe7d2-d61b-4eb7-9e87-f9d1198a1b5c req-c954c0b1-7023-4b5c-b695-75d273901d41 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:52:30.985014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-17cbe7d2-d61b-4eb7-9e87-f9d1198a1b5c req-c954c0b1-7023-4b5c-b695-75d273901d41 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:52:30.996903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-17cbe7d2-d61b-4eb7-9e87-f9d1198a1b5c req-c954c0b1-7023-4b5c-b695-75d273901d41 service nova] Creating event network-changed:d4f21594-9658-4ae7-9230-c7fb2c959577 for instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 on hv-cinder-84890 Aug 24 15:52:31.001815 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-17cbe7d2-d61b-4eb7-9e87-f9d1198a1b5c req-c954c0b1-7023-4b5c-b695-75d273901d41 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032626 Aug 24 15:52:31.002441 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 662/1228] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:53:14.259122 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:53:14.259631 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:54:44.695387 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a274be5-ead9-427c-bc47-1f1e483c46dd] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 15:54:44.696125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:44.696817 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=92 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:44.701879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:44.702497 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:44.710043 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.710564 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.710999 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.711681 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.712131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.712552 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.736883 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:54:44.814984 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2084de0d-0660-4bf6-bcc0-d1a31ef4230e tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 204 len: 0 microversion: 2.1 time: 0.121273 Aug 24 15:54:44.815775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 663/1229] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:54:44 2022] DELETE /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:54:44.824278 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:44.824963 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:44.830683 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.831155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.831579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.832253 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:44.832696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:44.833109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:44.967560 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:44.975389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b1f36fa9-1918-4297-8203-e55370b6ea06 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1578 microversion: 2.1 time: 0.155161 Aug 24 15:54:44.975953 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 664/1230] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:44 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:54:45.996782 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:45.997957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:46.005979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.006487 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.006916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.007593 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:46.008037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:46.008456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:46.011884 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a274be5-ead9-427c-bc47-1f1e483c46dd] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 35552. Aug 24 15:54:46.142112 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:46.150090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-10f76a68-1f80-47c6-bf28-e0b5894624fe tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1578 microversion: 2.1 time: 0.157084 Aug 24 15:54:46.150941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 665/1231] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:45 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:47.171738 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:47.172421 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:47.179447 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.179921 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.180349 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.181039 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.181486 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.181900 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.244509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:47.252072 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8af0b7d6-d1a4-4b6d-b13b-c03a88167646 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 200 len: 1510 microversion: 2.1 time: 0.084445 Aug 24 15:54:47.252641 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 666/1232] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:47 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:47.470016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-e80eafd2-82b9-4cd4-95fe-65dec2f2ae49 req-d8aea10d-208a-4e6a-b41e-0f4236a5ea9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c07a8d9-5110-4802-8abf-7c455e92f1a9", "name": "network-vif-deleted", "tag": "d4f21594-9658-4ae7-9230-c7fb2c959577"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:54:47.480208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-e80eafd2-82b9-4cd4-95fe-65dec2f2ae49 req-d8aea10d-208a-4e6a-b41e-0f4236a5ea9c service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:47.480676 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-e80eafd2-82b9-4cd4-95fe-65dec2f2ae49 req-d8aea10d-208a-4e6a-b41e-0f4236a5ea9c service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:47.481107 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-e80eafd2-82b9-4cd4-95fe-65dec2f2ae49 req-d8aea10d-208a-4e6a-b41e-0f4236a5ea9c service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:47.494775 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-e80eafd2-82b9-4cd4-95fe-65dec2f2ae49 req-d8aea10d-208a-4e6a-b41e-0f4236a5ea9c service nova] Creating event network-vif-deleted:d4f21594-9658-4ae7-9230-c7fb2c959577 for instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 on hv-cinder-84890 Aug 24 15:54:47.501581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-e80eafd2-82b9-4cd4-95fe-65dec2f2ae49 req-d8aea10d-208a-4e6a-b41e-0f4236a5ea9c service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106091 Aug 24 15:54:47.502296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 667/1233] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:48.274162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:48.275003 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:48.281894 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.282396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.282828 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.283516 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.283962 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.284379 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.298700 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] HTTP exception thrown: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Request method failure captured: Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 HTTP/1.1 Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkkSSvdSaWfbJMboi20d-YrTcE8k1arypL9gzwjeVYRILymEiSDpuXhc-1C7VezXSVRzhMuq8nLjS7aa5u4KpYRPWvcmeG9FEKK8iBTSvGmvBJazW9H8PVxHssk9YuNMkJsakGhVnSOKl-XFGoeF0uWwiMbpOLkGfVdJF2zWhnYhv08 Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:54:48.300312 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ae3022891c914ea18ffacc414b55fb7e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}] Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1151eb3a305e4c18b8cc5717379bce63 Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:54:48.301880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '7c07a8d9-5110-4802-8abf-7c455e92f1a9'} Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:54:48.302818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:54:48.304381 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:54:48.305649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Returning 404 to user: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:54:48.305649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1da5a24e-4695-4b8d-a3b0-2834c0cd0a3d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 404 len: 111 microversion: 2.1 time: 0.032128 Aug 24 15:54:48.305649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 668/1234] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:48 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:54:48.350530 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-775883880", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1806751018", "security_groups": [{"name": "tempest-secgroup-smoke-1866202252"}], "block_device_mapping_v2": [{"uuid": "7f8ff1e9-9255-43ea-a214-097ea3484921", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca94763a-7a29-4e38-a07a-e4db5955b3c4"}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:54:48.466529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] validate_networks() for [('ca94763a-7a29-4e38-a07a-e4db5955b3c4', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:54:48.874454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:54:48.874881 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:54:48.875357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:54:48.875781 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:54:48.876260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:54:48.885182 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.885669 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.886106 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.886869 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:48.887314 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:48.887737 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:48.905974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for project ae3022891c914ea18ffacc414b55fb7e. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:54:48.909939 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for user 1151eb3a305e4c18b8cc5717379bce63 and project ae3022891c914ea18ffacc414b55fb7e. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:54:48.966926 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:54:48.969176 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f8ff1e9-9255-43ea-a214-097ea3484921',volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:54:49.094670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [104df381-731e-4198-8bcb-86f87d5bffbb] AMQP server on 10.222.0.76:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 15:54:50.104046 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [104df381-731e-4198-8bcb-86f87d5bffbb] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 35582. Aug 24 15:54:50.109214 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f9df7bfc-ef77-4f8e-a6f9-079f525b2909 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.762485 Aug 24 15:54:50.116035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 669/1235] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:54:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:54:50.120791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-92603844-bde3-4776-9f26-1f59a35fa1d5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:50.121398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-92603844-bde3-4776-9f26-1f59a35fa1d5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:50.178630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-92603844-bde3-4776-9f26-1f59a35fa1d5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:50.185437 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-92603844-bde3-4776-9f26-1f59a35fa1d5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1094 microversion: 2.1 time: 0.068322 Aug 24 15:54:50.185992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 670/1236] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:50 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:54:51.205954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-55859f45-dec9-4694-9fe4-b1d8b305b6ef tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:51.206603 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-55859f45-dec9-4694-9fe4-b1d8b305b6ef tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:51.259133 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-55859f45-dec9-4694-9fe4-b1d8b305b6ef tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:51.266458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-55859f45-dec9-4694-9fe4-b1d8b305b6ef tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1094 microversion: 2.1 time: 0.064254 Aug 24 15:54:51.267030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 671/1237] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:51 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:52.287596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-238fdf96-4915-4fcb-9dc9-d22255ef09d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:52.288208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-238fdf96-4915-4fcb-9dc9-d22255ef09d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:52.341335 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-238fdf96-4915-4fcb-9dc9-d22255ef09d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:52.350047 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-238fdf96-4915-4fcb-9dc9-d22255ef09d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1094 microversion: 2.1 time: 0.066182 Aug 24 15:54:52.350645 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 672/1238] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:52 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:53.371473 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-78530194-b451-4e6e-94e7-07a8b57ca3cd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:53.372639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-78530194-b451-4e6e-94e7-07a8b57ca3cd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:53.429286 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-78530194-b451-4e6e-94e7-07a8b57ca3cd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:53.436901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-78530194-b451-4e6e-94e7-07a8b57ca3cd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1094 microversion: 2.1 time: 0.069253 Aug 24 15:54:53.437779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 673/1239] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:53 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:54.458450 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:54.459153 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:54.465443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.465916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.466373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.467058 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:54.467502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:54.467922 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:54.535012 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:54.543780 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fc110c5a-b28f-4e49-aba9-fa1c9a19cf83 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1144 microversion: 2.1 time: 0.089076 Aug 24 15:54:54.544458 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 674/1240] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:54 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:55.567871 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:55.568576 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:55.575137 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.575684 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.576391 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.577744 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:55.578323 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:55.578810 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:55.641668 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:55.649382 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1bbb2e28-cd68-4fb1-81f1-7bf03139c3d6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1210 microversion: 2.1 time: 0.085359 Aug 24 15:54:55.649947 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 675/1241] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:55 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:56.375655 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-9db98f09-92b4-4e76-adb9-fbc471c2eeab req-ae6002c2-8b0b-4c8a-83b1-535d6f339e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2109545c-3b30-4d69-8da2-32bc17ba42ef", "tag": "eb93d1d5-e349-44f9-a1e0-129e81c31125"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:54:56.386913 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-9db98f09-92b4-4e76-adb9-fbc471c2eeab req-ae6002c2-8b0b-4c8a-83b1-535d6f339e77 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.387386 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-9db98f09-92b4-4e76-adb9-fbc471c2eeab req-ae6002c2-8b0b-4c8a-83b1-535d6f339e77 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.387812 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-9db98f09-92b4-4e76-adb9-fbc471c2eeab req-ae6002c2-8b0b-4c8a-83b1-535d6f339e77 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.400301 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-9db98f09-92b4-4e76-adb9-fbc471c2eeab req-ae6002c2-8b0b-4c8a-83b1-535d6f339e77 service nova] Creating event network-changed:eb93d1d5-e349-44f9-a1e0-129e81c31125 for instance 2109545c-3b30-4d69-8da2-32bc17ba42ef on hv-cinder-84890 Aug 24 15:54:56.406111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-9db98f09-92b4-4e76-adb9-fbc471c2eeab req-ae6002c2-8b0b-4c8a-83b1-535d6f339e77 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035107 Aug 24 15:54:56.406733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 676/1242] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:54:56.672019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:56.672843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:56.679367 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.679843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.680268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.680954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:56.681393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:56.681811 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:56.820117 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:56.828232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6ae5cfb4-6313-4741-acb1-355cedbfef28 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.161320 Aug 24 15:54:56.828798 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 677/1243] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:56 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:57.849942 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:57.850727 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:57.857034 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.857518 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.858628 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.859353 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:57.859809 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:57.860235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:57.994991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:58.003457 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-163a0c8a-9ed2-4fe1-9d15-ccf2c31e5ec6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.157539 Aug 24 15:54:58.006010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 678/1244] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:57 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:54:59.024757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:54:59.025402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:54:59.027665 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:54:59.032975 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.033454 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.033887 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.034610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:54:59.035061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:54:59.035482 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:54:59.166443 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:54:59.175065 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5be9bf20-1c5d-411e-b8dc-d8ebdf3ffa5b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.154220 Aug 24 15:54:59.175631 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 679/1245] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:54:59 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:00.196100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:00.196710 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:00.203557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.204037 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.204466 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.205167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:00.205601 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:00.206017 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:00.335266 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:00.343061 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-b0d1267c-35e8-4b77-95d8-661fcd25685d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.150894 Aug 24 15:55:00.343934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 680/1246] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:00 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:01.364887 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:01.365581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:01.371855 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.372331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.372764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.373444 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:01.373892 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:01.374356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:01.505921 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:01.514725 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6ca63465-e25a-46e0-bb1c-88cbf7569d26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.153093 Aug 24 15:55:01.515610 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 681/1247] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:01 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:02.535258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:02.535903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:02.542204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.542703 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.543130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.543805 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:02.544251 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:02.544670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:02.645959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:55:02.646174 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef (ip 10.222.0.76) !!! Aug 24 15:55:02.673273 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:02.680838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7ea22c62-3f45-4b03-b0d9-1cbe8f9e6b26 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.149406 Aug 24 15:55:02.681395 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 682/1248] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:02 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:03.700972 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:03.702136 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:03.703843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=14 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:03.709600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.710074 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.710541 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.711229 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:03.711678 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:03.712101 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:03.844796 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:03.852355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ce54375e-2b66-4f40-84a1-e139243382f8 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.155304 Aug 24 15:55:03.852916 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 683/1249] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:03 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:04.872885 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:04.873544 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:04.880376 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.880849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.881282 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.881966 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:04.882448 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:04.882870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:04.906637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:55:05.023724 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:05.031521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3414254f-55d5-4e93-bc41-4a412350dd79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.162483 Aug 24 15:55:05.032201 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 684/1250] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:04 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:06.052116 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:06.052822 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:06.059056 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.059529 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.059960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.060634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.061082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.061499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.198624 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:06.209688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-df6533c4-4784-428b-8b07-d27176afff79 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.161488 Aug 24 15:55:06.210284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 685/1251] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:06 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:06.710110 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-0c549791-a172-484d-9df4-63937e00af8c req-b3cd157b-db9c-495a-b962-aa3982fa3687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2109545c-3b30-4d69-8da2-32bc17ba42ef", "name": "network-vif-plugged", "status": "completed", "tag": "eb93d1d5-e349-44f9-a1e0-129e81c31125"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:55:06.720896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-0c549791-a172-484d-9df4-63937e00af8c req-b3cd157b-db9c-495a-b962-aa3982fa3687 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:06.721670 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-0c549791-a172-484d-9df4-63937e00af8c req-b3cd157b-db9c-495a-b962-aa3982fa3687 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:06.722100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-0c549791-a172-484d-9df4-63937e00af8c req-b3cd157b-db9c-495a-b962-aa3982fa3687 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:06.733084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-0c549791-a172-484d-9df4-63937e00af8c req-b3cd157b-db9c-495a-b962-aa3982fa3687 service nova] Creating event network-vif-plugged:eb93d1d5-e349-44f9-a1e0-129e81c31125 for instance 2109545c-3b30-4d69-8da2-32bc17ba42ef on hv-cinder-84890 Aug 24 15:55:06.738096 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-0c549791-a172-484d-9df4-63937e00af8c req-b3cd157b-db9c-495a-b962-aa3982fa3687 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031712 Aug 24 15:55:06.738734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 686/1252] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:07.230790 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:07.231496 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:07.238199 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.238714 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.239156 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.239845 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:07.240296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:07.240722 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:07.370653 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:07.379418 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-7d1f0bf6-6010-4d10-ae9c-aa6d5af787c9 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.153286 Aug 24 15:55:07.379986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 687/1253] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:07 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:08.400545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:08.401901 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:08.408571 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.409284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.409903 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.410627 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:08.411078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:08.411511 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:08.556130 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:08.565151 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2ce6e426-4539-479b-b0d7-945595355164 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1266 microversion: 2.1 time: 0.168578 Aug 24 15:55:08.565954 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 688/1254] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:08 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:09.586596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:09.587215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:09.594296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.594777 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.595215 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.595902 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.596354 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.596778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.728959 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:09.736889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-fd7b8ba3-1199-4ac4-ae2d-c94c2dd64982 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1454 microversion: 2.1 time: 0.154173 Aug 24 15:55:09.737465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 689/1255] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:09 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:09.756018 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:55:09.756620 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:55:09.762272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.762757 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.763184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.763863 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:09.764311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:09.764734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:09.892919 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:55:09.900639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-9250fbb8-7582-423f-953d-e612d35b57de tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1454 microversion: 2.1 time: 0.148123 Aug 24 15:55:09.901207 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 690/1256] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:55:09 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:55:11.721577 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-4914c9eb-4401-411d-9043-a98b4a4831de req-9fd09beb-ea4f-47b0-89bf-f1b9ca7e68c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2109545c-3b30-4d69-8da2-32bc17ba42ef", "tag": "eb93d1d5-e349-44f9-a1e0-129e81c31125"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:55:11.731745 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-4914c9eb-4401-411d-9043-a98b4a4831de req-9fd09beb-ea4f-47b0-89bf-f1b9ca7e68c2 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:55:11.732218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-4914c9eb-4401-411d-9043-a98b4a4831de req-9fd09beb-ea4f-47b0-89bf-f1b9ca7e68c2 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:55:11.732651 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-4914c9eb-4401-411d-9043-a98b4a4831de req-9fd09beb-ea4f-47b0-89bf-f1b9ca7e68c2 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:55:11.746337 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-4914c9eb-4401-411d-9043-a98b4a4831de req-9fd09beb-ea4f-47b0-89bf-f1b9ca7e68c2 service nova] Creating event network-changed:eb93d1d5-e349-44f9-a1e0-129e81c31125 for instance 2109545c-3b30-4d69-8da2-32bc17ba42ef on hv-cinder-84890 Aug 24 15:55:11.751786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-4914c9eb-4401-411d-9043-a98b4a4831de req-9fd09beb-ea4f-47b0-89bf-f1b9ca7e68c2 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033860 Aug 24 15:55:11.752371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 691/1257] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:55:19.328321 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:55:19.328930 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:56:34.267183 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:56:34.267922 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:57:11.667977 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a274be5-ead9-427c-bc47-1f1e483c46dd] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 15:57:11.668639 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:11.669373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=36 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:11.674331 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-329102794", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1806751018", "security_groups": [{"name": "tempest-secgroup-smoke-1866202252"}], "block_device_mapping_v2": [{"uuid": "4d424328-2c60-4a7d-8705-83cc7339e0ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca94763a-7a29-4e38-a07a-e4db5955b3c4"}]}} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:57:11.787453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.network.neutron [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] validate_networks() for [('ca94763a-7a29-4e38-a07a-e4db5955b3c4', None, None, None, None, None)] {{(pid=120849) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 15:57:12.155022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Flavor limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 15:57:12.155462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Image limits 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 15:57:12.155930 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Flavor pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 15:57:12.156332 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Image pref 0:0:0 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 15:57:12.156763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.virt.hardware [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 15:57:12.165232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.165702 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.166131 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.166875 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:12.167317 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:12.167734 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:12.185765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for project ae3022891c914ea18ffacc414b55fb7e. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 15:57:12.189843 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.quota [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Getting quotas for user 1151eb3a305e4c18b8cc5717379bce63 and project ae3022891c914ea18ffacc414b55fb7e. Resources: {'instances', 'ram', 'cores'} {{(pid=120849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 15:57:12.246129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Going to run 1 instances... {{(pid=120849) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 15:57:12.254396 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d424328-2c60-4a7d-8705-83cc7339e0ac',volume_size=None,volume_type=None)] {{(pid=120849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 15:57:12.380820 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ab79e8d3-230a-49eb-8585-0c38bb526666 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714637 Aug 24 15:57:12.381446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 692/1258] 10.222.0.76 () {60 vars in 1147 bytes} [Wed Aug 24 15:57:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 15:57:12.391873 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8ef52d01-0d49-47bd-b744-d5998ac0b7c3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:12.392481 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8ef52d01-0d49-47bd-b744-d5998ac0b7c3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:12.445957 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8ef52d01-0d49-47bd-b744-d5998ac0b7c3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:12.454630 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8ef52d01-0d49-47bd-b744-d5998ac0b7c3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1094 microversion: 2.1 time: 0.066326 Aug 24 15:57:12.455188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 693/1259] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:12 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:13.474857 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:13.475465 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:13.487786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a274be5-ead9-427c-bc47-1f1e483c46dd] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 35756. Aug 24 15:57:13.490689 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.491180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.491608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.492306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:13.492750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:13.493169 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:13.557019 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:13.565192 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-62f4959a-38e8-4357-a24b-91387b52aa47 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1210 microversion: 2.1 time: 0.094086 Aug 24 15:57:13.565951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 694/1260] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:13 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:14.587077 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:14.587732 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:14.594293 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.594771 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.595208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.595897 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.596373 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.596797 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.789573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:14.797298 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-2e8c5820-6a8c-426e-a1d1-8aa72294d7c6 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.213987 Aug 24 15:57:14.798123 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 695/1261] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:14 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:14.802613 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-24425ab0-ea0d-46fa-9380-40886a2ce33a req-be769afa-e421-4f02-b4e0-e1b95a286ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b07d5aa-2092-4698-b3d6-b90f70cb8fc7", "tag": "6b878264-4743-4ce6-a180-663d7251c734"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:57:14.811575 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-24425ab0-ea0d-46fa-9380-40886a2ce33a req-be769afa-e421-4f02-b4e0-e1b95a286ed1 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:14.812042 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-24425ab0-ea0d-46fa-9380-40886a2ce33a req-be769afa-e421-4f02-b4e0-e1b95a286ed1 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:14.812464 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-24425ab0-ea0d-46fa-9380-40886a2ce33a req-be769afa-e421-4f02-b4e0-e1b95a286ed1 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:14.823748 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-24425ab0-ea0d-46fa-9380-40886a2ce33a req-be769afa-e421-4f02-b4e0-e1b95a286ed1 service nova] Creating event network-changed:6b878264-4743-4ce6-a180-663d7251c734 for instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 on hv-cinder-84890 Aug 24 15:57:14.828788 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-24425ab0-ea0d-46fa-9380-40886a2ce33a req-be769afa-e421-4f02-b4e0-e1b95a286ed1 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029461 Aug 24 15:57:14.829393 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 696/1262] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:57:15.819934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:15.820582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:15.826648 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.827125 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.827559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.828242 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:15.828688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:15.829111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:15.965260 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:15.972994 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-425e6964-6765-4019-9337-8ba7c43ad807 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.158397 Aug 24 15:57:15.973568 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 697/1263] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:15 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:16.994016 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:16.994694 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:17.000985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.001452 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.001879 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.002583 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:17.003023 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:17.003448 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:17.132032 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:17.139660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cb09114d-3873-4113-85c9-302631874fa3 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.149480 Aug 24 15:57:17.140213 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 698/1264] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:16 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:18.161480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:18.162165 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:18.168582 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.168894 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.169326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.170010 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:18.170480 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:18.170905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:18.307992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:18.315804 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5f9d6ee7-aa83-4628-bfe5-f880056e695d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.158754 Aug 24 15:57:18.316403 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 699/1265] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:18 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:19.336629 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:19.337334 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:19.343609 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.344083 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.344510 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.345194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:19.345643 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:19.346066 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:19.477768 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:19.485507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f2ed32e0-98b1-4080-8ba0-f1666e5078bd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.152683 Aug 24 15:57:19.486068 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 700/1266] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:19 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:20.506991 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:20.507647 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:20.514022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.514527 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.514958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.515847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:20.516290 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:20.516707 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:20.649356 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:20.656870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-6357cc14-2886-4977-b9ef-a52708a412b5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.154336 Aug 24 15:57:20.657425 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 701/1267] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:20 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:21.677844 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:21.678580 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:21.685074 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.685545 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.685974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:21.686696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:21.687142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:21.687562 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:22.051747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:22.059417 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-3e55cabf-a8e3-4767-9685-343eca6abf92 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.385975 Aug 24 15:57:22.059979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 702/1268] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:21 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:23.080747 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:23.081374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:23.083772 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=2 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:23.084453 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell0:SELECT=8 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:23.090696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.091181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.091619 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.092326 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:23.092791 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:23.093218 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:23.222573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:23.230181 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-ed2fa4de-93c1-4bc9-9cbb-9c2be0813b73 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.153336 Aug 24 15:57:23.230779 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 703/1269] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:23 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:24.251216 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:24.251848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:24.258874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.259355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.259792 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.260492 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:24.260946 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:24.261370 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:24.391285 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:24.398967 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-439093fe-1e9d-499b-847b-86ebb2303624 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.151582 Aug 24 15:57:24.399526 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 704/1270] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:24 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:57:25.420203 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:25.420793 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:25.428596 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.429078 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.429514 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.430209 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:25.430836 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:25.431084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:25.562868 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:25.571189 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-80fce01c-02f7-4823-b7eb-5a3920b4f832 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.155045 Aug 24 15:57:25.571758 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 705/1271] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:25 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:26.591430 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:26.592081 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:26.598617 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.599122 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.599557 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.600241 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:26.600688 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:26.601109 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:26.731336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:26.738905 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-38e38f5b-5285-4c40-87d4-ed8fc328c4e5 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.151308 Aug 24 15:57:26.739463 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 706/1272] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:26 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:57:27.402402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-4abd7cb4-ca2e-4a37-88d5-236385b98381 req-f8f78aaf-d5f1-4138-aecb-65fc1f52fd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b07d5aa-2092-4698-b3d6-b90f70cb8fc7", "name": "network-vif-plugged", "status": "completed", "tag": "6b878264-4743-4ce6-a180-663d7251c734"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:57:27.412476 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-4abd7cb4-ca2e-4a37-88d5-236385b98381 req-f8f78aaf-d5f1-4138-aecb-65fc1f52fd39 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.412941 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-4abd7cb4-ca2e-4a37-88d5-236385b98381 req-f8f78aaf-d5f1-4138-aecb-65fc1f52fd39 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.413363 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-4abd7cb4-ca2e-4a37-88d5-236385b98381 req-f8f78aaf-d5f1-4138-aecb-65fc1f52fd39 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.424477 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-4abd7cb4-ca2e-4a37-88d5-236385b98381 req-f8f78aaf-d5f1-4138-aecb-65fc1f52fd39 service nova] Creating event network-vif-plugged:6b878264-4743-4ce6-a180-663d7251c734 for instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 on hv-cinder-84890 Aug 24 15:57:27.430402 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-4abd7cb4-ca2e-4a37-88d5-236385b98381 req-f8f78aaf-d5f1-4138-aecb-65fc1f52fd39 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102284 Aug 24 15:57:27.430912 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 707/1273] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:57:27.759961 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:27.760677 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:27.767191 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.767662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.768090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.768765 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:27.769711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:27.770158 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:27.897180 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:27.904731 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-8edf0f89-0120-4c72-8d82-8187b7d41596 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.148977 Aug 24 15:57:27.905287 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 708/1274] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:27 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:28.925135 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:28.926462 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:28.932823 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.933299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.933733 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:28.934521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:28.934974 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:28.935404 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:29.068311 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:29.076226 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-5ba93914-8e1a-4a37-918b-88da1a638c49 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1266 microversion: 2.1 time: 0.155246 Aug 24 15:57:29.076786 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 709/1275] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:28 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:30.096849 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:30.097508 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:30.104280 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.104755 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.105188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.105880 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.106357 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.106783 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.236268 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:30.244484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-1059f5b3-c154-4eef-b15a-e9865bf790a2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1453 microversion: 2.1 time: 0.151442 Aug 24 15:57:30.245057 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 710/1276] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:30 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:30.264384 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:57:30.264979 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:57:30.270559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.271030 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.271456 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.272129 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:30.272570 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:30.272987 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:30.290764 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=100 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:57:30.403654 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:57:30.411802 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-373fdca9-f08f-46fa-91d2-3c94b6a87538 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1453 microversion: 2.1 time: 0.150949 Aug 24 15:57:30.412362 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 711/1277] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:57:30 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:57:32.265134 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-ab6f1325-4093-4de2-9665-f580e481fe69 req-befb080e-37b5-4f23-a4ae-fa463fd72413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b07d5aa-2092-4698-b3d6-b90f70cb8fc7", "tag": "6b878264-4743-4ce6-a180-663d7251c734"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:57:32.274769 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ab6f1325-4093-4de2-9665-f580e481fe69 req-befb080e-37b5-4f23-a4ae-fa463fd72413 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:57:32.275237 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ab6f1325-4093-4de2-9665-f580e481fe69 req-befb080e-37b5-4f23-a4ae-fa463fd72413 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:57:32.275662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-ab6f1325-4093-4de2-9665-f580e481fe69 req-befb080e-37b5-4f23-a4ae-fa463fd72413 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:57:32.286431 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-ab6f1325-4093-4de2-9665-f580e481fe69 req-befb080e-37b5-4f23-a4ae-fa463fd72413 service nova] Creating event network-changed:6b878264-4743-4ce6-a180-663d7251c734 for instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 on hv-cinder-84890 Aug 24 15:57:32.291344 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-ab6f1325-4093-4de2-9665-f580e481fe69 req-befb080e-37b5-4f23-a4ae-fa463fd72413 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029915 Aug 24 15:57:32.292059 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 712/1278] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:58:22.654267 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:58:22.654923 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 15:58:39.335858 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:58:39.336443 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:59:21.902429 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a274be5-ead9-427c-bc47-1f1e483c46dd] AMQP server on 10.222.0.76:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 15:59:21.902985 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:21.904008 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG dbcounter [-] [120849] Writing DB stats nova_cell1:SELECT=4 {{(pid=120849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:59:21.908673 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:21.909261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:21.917258 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:21.917741 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:21.918171 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:21.918906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:21.919355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:21.919778 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:21.948559 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:59:22.026428 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-e613f0d5-bfac-4265-892b-dd16aa799560 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "DELETE /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 204 len: 0 microversion: 2.1 time: 0.127510 Aug 24 15:59:22.026986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 713/1279] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:59:21 2022] DELETE /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 15:59:22.102814 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-eb5ac396-cf3a-48ed-a7bb-d6863a79ba55 req-e66f1df0-f715-478b-a02b-0786f98910ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b07d5aa-2092-4698-b3d6-b90f70cb8fc7", "tag": "6b878264-4743-4ce6-a180-663d7251c734"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:22.113062 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-eb5ac396-cf3a-48ed-a7bb-d6863a79ba55 req-e66f1df0-f715-478b-a02b-0786f98910ea service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.113534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-eb5ac396-cf3a-48ed-a7bb-d6863a79ba55 req-e66f1df0-f715-478b-a02b-0786f98910ea service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.113960 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-eb5ac396-cf3a-48ed-a7bb-d6863a79ba55 req-e66f1df0-f715-478b-a02b-0786f98910ea service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.125419 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-eb5ac396-cf3a-48ed-a7bb-d6863a79ba55 req-e66f1df0-f715-478b-a02b-0786f98910ea service nova] Creating event network-changed:6b878264-4743-4ce6-a180-663d7251c734 for instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 on hv-cinder-84890 Aug 24 15:59:22.130993 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-eb5ac396-cf3a-48ed-a7bb-d6863a79ba55 req-e66f1df0-f715-478b-a02b-0786f98910ea service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102691 Aug 24 15:59:22.131577 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 714/1280] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:22.136716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:22.137398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:22.143398 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.143870 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.144296 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.144976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:22.145420 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:22.145838 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:22.286208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:22.293917 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-787ceab1-5e2a-495c-a0fb-cbfa1fb4f301 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1578 microversion: 2.1 time: 0.161253 Aug 24 15:59:22.294503 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 715/1281] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:22 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:59:23.317740 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:23.318389 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:23.326521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:23.326995 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:23.327424 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:23.328113 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:23.328553 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:23.328971 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:23.337142 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a274be5-ead9-427c-bc47-1f1e483c46dd] Reconnected to AMQP server on 10.222.0.76:5672 via [amqp] client with port 35850. Aug 24 15:59:23.475204 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:23.483474 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-23ca3923-607c-4073-90cb-cbe75ece3d9a tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1578 microversion: 2.1 time: 0.171321 Aug 24 15:59:23.484534 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 716/1282] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:23 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:59:24.381416 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-bd550c3a-9ad4-4560-8a4a-b7fde78b6459 req-d52f80ab-9379-4537-b415-f48d8874826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b07d5aa-2092-4698-b3d6-b90f70cb8fc7", "name": "network-vif-deleted", "tag": "6b878264-4743-4ce6-a180-663d7251c734"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:24.393014 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-bd550c3a-9ad4-4560-8a4a-b7fde78b6459 req-d52f80ab-9379-4537-b415-f48d8874826a service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.393581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-bd550c3a-9ad4-4560-8a4a-b7fde78b6459 req-d52f80ab-9379-4537-b415-f48d8874826a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.394184 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-bd550c3a-9ad4-4560-8a4a-b7fde78b6459 req-d52f80ab-9379-4537-b415-f48d8874826a service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.405579 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-bd550c3a-9ad4-4560-8a4a-b7fde78b6459 req-d52f80ab-9379-4537-b415-f48d8874826a service nova] Creating event network-vif-deleted:6b878264-4743-4ce6-a180-663d7251c734 for instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 on hv-cinder-84890 Aug 24 15:59:24.410589 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-bd550c3a-9ad4-4560-8a4a-b7fde78b6459 req-d52f80ab-9379-4537-b415-f48d8874826a service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Aug 24 15:59:24.411175 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 717/1283] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:59:24.506235 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:24.506938 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:24.513090 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.513567 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.514000 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.514717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:24.515167 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:24.516279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:24.581742 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:24.589716 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-f092c758-b9d6-4e81-887b-45da3919306f tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 200 len: 1225 microversion: 2.1 time: 0.087701 Aug 24 15:59:24.590299 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 718/1284] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:24 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:59:25.610026 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:25.610696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:25.617100 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:25.617556 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:25.617989 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:25.618717 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:25.619166 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:25.619591 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:25.632958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] HTTP exception thrown: Instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 could not be found. Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Request method failure captured: Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 HTTP/1.1 Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkkSSvdSaWfbJMboi20d-YrTcE8k1arypL9gzwjeVYRILymEiSDpuXhc-1C7VezXSVRzhMuq8nLjS7aa5u4KpYRPWvcmeG9FEKK8iBTSvGmvBJazW9H8PVxHssk9YuNMkJsakGhVnSOKl-XFGoeF0uWwiMbpOLkGfVdJF2zWhnYhv08 Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:59:25.634649 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ae3022891c914ea18ffacc414b55fb7e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}] Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1151eb3a305e4c18b8cc5717379bce63 Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 could not be found. Aug 24 15:59:25.636479 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '8b07d5aa-2092-4698-b3d6-b90f70cb8fc7'} Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 could not be found. Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:59:25.637509 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 could not be found. Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 could not be found. Aug 24 15:59:25.639232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:25.641573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Returning 404 to user: Instance 8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:59:25.641573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a4ecdc6c-5c03-4fc4-a2da-72c7468ca988 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7" status: 404 len: 111 microversion: 2.1 time: 0.029987 Aug 24 15:59:25.641573 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 719/1285] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:25 2022] GET /compute/v2.1/servers/8b07d5aa-2092-4698-b3d6-b90f70cb8fc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:59:28.694992 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:28.695794 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:28.702186 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.702766 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.703272 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.704035 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.705095 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.705608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.733847 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Going to try to terminate instance {{(pid=120849) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 15:59:28.812696 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-cddfae65-f7d3-4c2b-b09c-5474392369af tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "DELETE /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 204 len: 0 microversion: 2.1 time: 0.121178 Aug 24 15:59:28.813355 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 720/1286] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:59:28 2022] DELETE /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 15:59:28.820656 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-26b35a39-0cb7-4149-8ab3-2042ba60650e req-19c06b7e-a492-4e59-8fe2-c5a5b6c48e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2109545c-3b30-4d69-8da2-32bc17ba42ef", "tag": "eb93d1d5-e349-44f9-a1e0-129e81c31125"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:28.830951 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-26b35a39-0cb7-4149-8ab3-2042ba60650e req-19c06b7e-a492-4e59-8fe2-c5a5b6c48e76 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.831422 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-26b35a39-0cb7-4149-8ab3-2042ba60650e req-19c06b7e-a492-4e59-8fe2-c5a5b6c48e76 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.831848 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-26b35a39-0cb7-4149-8ab3-2042ba60650e req-19c06b7e-a492-4e59-8fe2-c5a5b6c48e76 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.842581 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-26b35a39-0cb7-4149-8ab3-2042ba60650e req-19c06b7e-a492-4e59-8fe2-c5a5b6c48e76 service nova] Creating event network-changed:eb93d1d5-e349-44f9-a1e0-129e81c31125 for instance 2109545c-3b30-4d69-8da2-32bc17ba42ef on hv-cinder-84890 Aug 24 15:59:28.848244 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-26b35a39-0cb7-4149-8ab3-2042ba60650e req-19c06b7e-a492-4e59-8fe2-c5a5b6c48e76 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Aug 24 15:59:28.848835 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 721/1287] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 15:59:28.853749 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:28.854461 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:28.860459 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.860940 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.861498 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:28.862185 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:28.862661 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:28.863082 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:29.005279 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:29.012976 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-30751473-23f8-4400-85b2-18a736f1d73b tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1579 microversion: 2.1 time: 0.163053 Aug 24 15:59:29.013542 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 722/1288] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:28 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 15:59:30.035053 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:30.035662 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:30.042020 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.042528 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.042958 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.043634 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.044079 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.044499 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.175523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:30.183371 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4ac1e8d0-3cec-416c-894b-4d34c5d4cd0d tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1579 microversion: 2.1 time: 0.152358 Aug 24 15:59:30.183934 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 723/1289] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:30 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:59:30.893896 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [req-746bd85f-c3af-490e-9894-48aa102eb54e req-78d12cac-6d5d-45a3-b3dc-9329bc38c690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2109545c-3b30-4d69-8da2-32bc17ba42ef", "name": "network-vif-deleted", "tag": "eb93d1d5-e349-44f9-a1e0-129e81c31125"}]} {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 15:59:30.903888 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-746bd85f-c3af-490e-9894-48aa102eb54e req-78d12cac-6d5d-45a3-b3dc-9329bc38c690 service nova] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:30.904507 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-746bd85f-c3af-490e-9894-48aa102eb54e req-78d12cac-6d5d-45a3-b3dc-9329bc38c690 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:30.904968 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [req-746bd85f-c3af-490e-9894-48aa102eb54e req-78d12cac-6d5d-45a3-b3dc-9329bc38c690 service nova] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:30.917188 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.compute.server_external_events [req-746bd85f-c3af-490e-9894-48aa102eb54e req-78d12cac-6d5d-45a3-b3dc-9329bc38c690 service nova] Creating event network-vif-deleted:eb93d1d5-e349-44f9-a1e0-129e81c31125 for instance 2109545c-3b30-4d69-8da2-32bc17ba42ef on hv-cinder-84890 Aug 24 15:59:30.921853 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [req-746bd85f-c3af-490e-9894-48aa102eb54e req-78d12cac-6d5d-45a3-b3dc-9329bc38c690 service nova] 10.222.0.76 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032517 Aug 24 15:59:30.922882 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 724/1290] 10.222.0.76 () {64 vars in 1317 bytes} [Wed Aug 24 15:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 15:59:31.207111 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:31.207818 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:31.214049 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.214561 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.215022 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.215726 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.216176 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.216604 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.248155 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:31.248637 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:31.249075 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:31.249524 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.objects.instance [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lazy-loading 'fault' on Instance uuid 2109545c-3b30-4d69-8da2-32bc17ba42ef {{(pid=120849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 15:59:31.293306 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.policy [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1151eb3a305e4c18b8cc5717379bce63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3022891c914ea18ffacc414b55fb7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120849) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 15:59:31.301405 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-19f8b39d-57f3-448f-9039-4ced852cf466 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 200 len: 1230 microversion: 2.1 time: 0.099854 Aug 24 15:59:31.301970 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 725/1291] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:31 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 15:59:32.322889 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:32.324525 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 2109545c-3b30-4d69-8da2-32bc17ba42ef] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:32.331608 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.332087 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.332523 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.333208 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.333660 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.334084 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.348194 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] HTTP exception thrown: Instance 2109545c-3b30-4d69-8da2-32bc17ba42ef could not be found. Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Request method failure captured: Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef HTTP/1.1 Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkkSSvdSaWfbJMboi20d-YrTcE8k1arypL9gzwjeVYRILymEiSDpuXhc-1C7VezXSVRzhMuq8nLjS7aa5u4KpYRPWvcmeG9FEKK8iBTSvGmvBJazW9H8PVxHssk9YuNMkJsakGhVnSOKl-XFGoeF0uWwiMbpOLkGfVdJF2zWhnYhv08 Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:59:32.349750 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ae3022891c914ea18ffacc414b55fb7e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}] Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1151eb3a305e4c18b8cc5717379bce63 Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 2109545c-3b30-4d69-8da2-32bc17ba42ef could not be found. Aug 24 15:59:32.351502 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '2109545c-3b30-4d69-8da2-32bc17ba42ef'} Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2109545c-3b30-4d69-8da2-32bc17ba42ef could not be found. Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:59:32.352446 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2109545c-3b30-4d69-8da2-32bc17ba42ef could not be found. Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2109545c-3b30-4d69-8da2-32bc17ba42ef could not be found. Aug 24 15:59:32.354162 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.355944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Returning 404 to user: Instance 2109545c-3b30-4d69-8da2-32bc17ba42ef could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:59:32.355944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-19a76f78-8a92-4001-9b15-bb396d684a33 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef" status: 404 len: 111 microversion: 2.1 time: 0.032285 Aug 24 15:59:32.355944 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 726/1292] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:32 2022] GET /compute/v2.1/servers/2109545c-3b30-4d69-8da2-32bc17ba42ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:59:32.800763 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:32.801261 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:32.807232 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.807711 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.808145 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.808834 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.809304 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.809706 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.825484 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] HTTP exception thrown: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Request method failure captured: Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: DELETE /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 HTTP/1.1 Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkkSSvdSaWfbJMboi20d-YrTcE8k1arypL9gzwjeVYRILymEiSDpuXhc-1C7VezXSVRzhMuq8nLjS7aa5u4KpYRPWvcmeG9FEKK8iBTSvGmvBJazW9H8PVxHssk9YuNMkJsakGhVnSOKl-XFGoeF0uWwiMbpOLkGfVdJF2zWhnYhv08 Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:59:32.827024 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ae3022891c914ea18ffacc414b55fb7e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}] Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1151eb3a305e4c18b8cc5717379bce63 Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.828800 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '7c07a8d9-5110-4802-8abf-7c455e92f1a9'} Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:59:32.830411 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.832104 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.833752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Returning 404 to user: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:59:32.833752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-d3043625-a26a-420f-9731-eee0335788ea tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "DELETE /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 404 len: 111 microversion: 2.1 time: 0.031762 Aug 24 15:59:32.833752 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 727/1293] 10.222.0.76 () {58 vars in 1239 bytes} [Wed Aug 24 15:59:32 2022] DELETE /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 15:59:32.837222 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:32.837819 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.compute.api [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] [instance: 7c07a8d9-5110-4802-8abf-7c455e92f1a9] Fetching instance by UUID {{(pid=120849) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 15:59:32.843485 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.843981 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.844413 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.845080 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Acquiring lock "fabf33d6-d538-4599-b25e-492b9bb37677" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 15:59:32.845521 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 15:59:32.845937 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG oslo_concurrency.lockutils [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Lock "fabf33d6-d538-4599-b25e-492b9bb37677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 15:59:32.858533 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.wsgi [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] HTTP exception thrown: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Request method failure captured: Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: request: GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 HTTP/1.1 Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept: application/json Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Accept-Encoding: identity Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Connection: close Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Length: 0 Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Content-Type: application/json Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Host: 10.222.0.76 Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Openstack-System-Scope: None Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: User-Agent: python-urllib3/1.26.11 Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Auth-Token: gAAAAABjBkkSSvdSaWfbJMboi20d-YrTcE8k1arypL9gzwjeVYRILymEiSDpuXhc-1C7VezXSVRzhMuq8nLjS7aa5u4KpYRPWvcmeG9FEKK8iBTSvGmvBJazW9H8PVxHssk9YuNMkJsakGhVnSOKl-XFGoeF0uWwiMbpOLkGfVdJF2zWhnYhv08 Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Id: None Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Domain-Name: None Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Identity-Status: Confirmed Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Is-Admin-Project: True Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Id: default Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Domain-Name: Default Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Project-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Role: reader,member Aug 24 15:59:32.859986 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Roles: reader,member Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76:8080/v1/AUTH_ae3022891c914ea18ffacc414b55fb7e", "adminURL": "http://10.222.0.76:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.76/volume/v3/ae3022891c914ea18ffacc414b55fb7e"}]}] Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Id: ae3022891c914ea18ffacc414b55fb7e Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1557136163 Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Id: default Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Domain-Name: Default Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Id: 1151eb3a305e4c18b8cc5717379bce63 Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: X-User-Name: tempest-TestVolumeBootPattern-1557136163-project Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: method: > Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: exception: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.861753 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: action_args: {'id': '7c07a8d9-5110-4802-8abf-7c455e92f1a9'} Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 15:59:32.862874 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. Aug 24 15:59:32.864606 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: ERROR nova.api.openstack.wsgi Aug 24 15:59:32.866063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Returning 404 to user: Instance 7c07a8d9-5110-4802-8abf-7c455e92f1a9 could not be found. {{(pid=120849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 15:59:32.866063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-a45aa404-ffb3-4f85-bea2-04039942fcc2 tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9" status: 404 len: 111 microversion: 2.1 time: 0.027819 Aug 24 15:59:32.866063 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 728/1294] 10.222.0.76 () {58 vars in 1236 bytes} [Wed Aug 24 15:59:32 2022] GET /compute/v2.1/servers/7c07a8d9-5110-4802-8abf-7c455e92f1a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 15:59:34.154973 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: DEBUG nova.api.openstack.wsgi [None req-4eecd3e4-cf17-46ca-b960-4b6f3e4d30dd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] Calling method '.version_select at 0x7f6659bf8160>' {{(pid=120849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 15:59:34.179336 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO nova.api.openstack.requestlog [None req-4eecd3e4-cf17-46ca-b960-4b6f3e4d30dd tempest-TestVolumeBootPattern-1557136163 tempest-TestVolumeBootPattern-1557136163-project] 10.222.0.76 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1806751018" status: 202 len: 0 microversion: 2.1 time: 0.028185 Aug 24 15:59:34.179906 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: [pid: 120849|app: 0|req: 729/1295] 10.222.0.76 () {58 vars in 1263 bytes} [Wed Aug 24 15:59:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1806751018 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 15:59:54.275516 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:59:54.276055 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 15:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 15:59:56.570839 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 15:59:56.571359 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 15:59:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:01:59.344689 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:01:59.345434 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 16:01:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 16:02:26.838813 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:02:26.839374 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 16:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:03:14.283388 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:03:14.284148 dv-cinder-848900-6-iscsi devstack@n-api.service[120848]: Wed Aug 24 16:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.76) !!! Aug 24 16:03:16.578635 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:03:16.579284 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 16:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 16:05:02.666918 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 16:05:02.667600 dv-cinder-848900-6-iscsi devstack@n-api.service[120849]: Wed Aug 24 16:05:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!